hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jason Lowe (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (MAPREDUCE-5059) Job overview shows average merge time larger than for any reduce attempt
Date Fri, 17 May 2013 15:59:16 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-5059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Jason Lowe updated MAPREDUCE-5059:
----------------------------------

    Fix Version/s: 0.23.8

Thanks, Omkar!  I committed this to branch-0.23 as well.
                
> Job overview shows average merge time larger than for any reduce attempt
> ------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-5059
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5059
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: jobhistoryserver, webapps
>            Reporter: Jason Lowe
>            Assignee: Omkar Vinit Joshi
>             Fix For: 2.0.5-beta, 0.23.8
>
>         Attachments: MAPREDUCE-5059-20130325.patch, MAPREDUCE-5059-20130410.patch
>
>
> When looking at a job overview page on the history server, the Average Merge Time is
often reported with a value that is far larger than the Elapsed Merge Time shown for any reduce
task attempt.  The job overview page calculates the merge time as the time delta between the
sort finishing and the job launching while the attempts page calculates it as the time delta
between the sort finishing and the shuffle finishing.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message