Mailing-List: contact mapreduce-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: mapreduce-issues@hadoop.apache.org
Message-ID: <9090197.180251288640908996.JavaMail.jira@thor>
Date: Mon, 1 Nov 2010 15:48:28 -0400 (EDT)
From: "Scott Chen (JIRA)" <jira@apache.org>
To: mapreduce-issues@hadoop.apache.org
Subject: [jira] Commented: (MAPREDUCE-2125) Put map-reduce framework
 counters to JobTrackerMetricsInst
In-Reply-To: <29141261.80521286820814020.JavaMail.jira@thor>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


    [ https://issues.apache.org/jira/browse/MAPREDUCE-2125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12927109#action_12927109 ] 

Scott Chen commented on MAPREDUCE-2125:
---------------------------------------

Sorry. I made a mistake in the previous comment. Please ignore the following comment. It is not correct.
{quote}
But here we do this in JobTrackerMetricsInst.doUpdates() which is called only every 5 seconds. So it has very minor impact on JT performance.
{quote}
You are right. The getCounter() will happen in completeJob(). But it is called once per job for the entire life-cycle of one job.
So it has very minor impact on JT performance.

> Put map-reduce framework counters to JobTrackerMetricsInst
> ----------------------------------------------------------
>
>                 Key: MAPREDUCE-2125
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2125
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: jobtracker
>    Affects Versions: 0.22.0
>            Reporter: Scott Chen
>            Assignee: Scott Chen
>             Fix For: 0.22.0
>
>         Attachments: MAPREDUCE-2125.txt
>
>
> We have lots of useful information in the framework counters including #spills, filesystem read and write.
> It will be nice to put them all in the jobtracker metrics to get a global view of all these numbers.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.