Mailing-List: contact mapreduce-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: mapreduce-issues@hadoop.apache.org
Message-ID: <17048771.178691288636592535.JavaMail.jira@thor>
Date: Mon, 1 Nov 2010 14:36:32 -0400 (EDT)
From: "Scott Chen (JIRA)" <jira@apache.org>
To: mapreduce-issues@hadoop.apache.org
Subject: [jira] Commented: (MAPREDUCE-2124) Add job counters for measuring
 time spent in three different phases in reducers
In-Reply-To: <25191716.80251286820213293.JavaMail.jira@thor>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


    [ https://issues.apache.org/jira/browse/MAPREDUCE-2124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12927078#action_12927078 ] 

Scott Chen commented on MAPREDUCE-2124:
---------------------------------------

I put test results in the attached file.
The following test failed. But it is not relevant to this change.

{code}
[junit] Running org.apache.hadoop.mapred.TestControlledMapReduceJob
[junit] Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 0 sec
{code}

> Add job counters for measuring time spent in three different phases in reducers
> -------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-2124
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2124
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: jobtracker
>    Affects Versions: 0.22.0
>            Reporter: Scott Chen
>            Assignee: Scott Chen
>            Priority: Minor
>             Fix For: 0.22.0
>
>         Attachments: MAPREDUCE-2124-v2.txt, MAPREDUCE-2124.txt, test-result.txt
>
>
> We currently have SLOTS_MILLIS_REDUCES which measures the total slot time of reducer.
> It will be useful if we have
> {code}
> SLOTS_MILLIS_REDUCES_COPY
> SLOTS_MILLIS_REDUCES_SORT
> SLOTS_MILLIS_REDUCES_REDUCE
> {code}
> which measures three different phases of a reducer.
> This will help us identify the bottleneck of the reducers.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.