hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-5059) Job overview shows average merge time larger than for any reduce attempt
Date Sat, 18 May 2013 12:41:17 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-5059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13661349#comment-13661349
] 

Hudson commented on MAPREDUCE-5059:
-----------------------------------

Integrated in Hadoop-Hdfs-0.23-Build #611 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/611/])
    svn merge -c 1467120 FIXES: MAPREDUCE-5059. Change average merge time on Job overview
page to be the time delta between the end of the shuffle and the start of the reduce. Contributed
by Omkar Vinit Joshi (Revision 1483885)

     Result = SUCCESS
jlowe : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1483885
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/webapp/dao/JobInfo.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/java/org/apache/hadoop/mapreduce/v2/hs/TestJobHistoryEntities.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/java/org/apache/hadoop/mapreduce/v2/hs/webapp/dao
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/java/org/apache/hadoop/mapreduce/v2/hs/webapp/dao/TestJobInfo.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/resources/job_1329348432655_0001-1329348443227-user-Sleep+job-1329348468601-10-1-SUCCEEDED-default.jhist

                
> Job overview shows average merge time larger than for any reduce attempt
> ------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-5059
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5059
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: jobhistoryserver, webapps
>            Reporter: Jason Lowe
>            Assignee: Omkar Vinit Joshi
>             Fix For: 2.0.5-beta, 0.23.8
>
>         Attachments: MAPREDUCE-5059-20130325.patch, MAPREDUCE-5059-20130410.patch
>
>
> When looking at a job overview page on the history server, the Average Merge Time is
often reported with a value that is far larger than the Elapsed Merge Time shown for any reduce
task attempt.  The job overview page calculates the merge time as the time delta between the
sort finishing and the job launching while the attempts page calculates it as the time delta
between the sort finishing and the shuffle finishing.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message