hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-5568) JHS returns invalid string for reducer completion percentage if AM restarts with 0 reducer.
Date Tue, 25 Nov 2014 21:11:15 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-5568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225213#comment-14225213
] 

Hudson commented on MAPREDUCE-5568:
-----------------------------------

FAILURE: Integrated in Hadoop-trunk-Commit #6603 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/6603/])
MAPREDUCE-5568. Fixed CompletedJob in JHS to show progress percentage correctly in case the
number of mappers or reducers is zero. Contributed by MinJi Kim (jianhe: rev 78f7cdbfd6e2b9fac51c369c748ae93d12ef065a)
* hadoop-mapreduce-project/CHANGES.txt
* hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/java/org/apache/hadoop/mapreduce/v2/hs/TestJobHistoryEntities.java
* hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/CompletedJob.java
* hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/resources/job_1416424547277_0002-1416424775281-root-TeraGen-1416424785433-2-0-SUCCEEDED-default-1416424779349.jhist


> JHS returns invalid string for reducer completion percentage if AM restarts with 0 reducer.
> -------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-5568
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5568
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>    Affects Versions: 2.4.1, 2.5.1
>            Reporter: Jian He
>            Assignee: MinJi Kim
>             Fix For: 2.7.0
>
>         Attachments: 5568.patch01, 5568.patch02, 5568.patch03, 5568.patch04
>
>
> JobCLient shows like:
> {code}
> 13/10/05 16:26:09 INFO mapreduce.Job:  map 100% reduce NaN%
> 13/10/05 16:26:09 INFO mapreduce.Job: Job job_1381015536254_0001 completed successfully
> 13/10/05 16:26:09 INFO mapreduce.Job: Counters: 26
> 	File System Counters
> 		FILE: Number of bytes read=0
> 		FILE: Number of bytes written=76741
> 		FILE: Number of read operations=0
> 		FILE: Number of large read operations=0
> 		FILE: Number of write operations=0
> 		HDFS: Number of bytes read=48
> 		HDFS: Number of bytes written=0
> 		HDFS: Number of read operations=1
> 		HDFS: Number of large read operations=0
> 		HDFS: Number of write operations=0
> {code}
> With mapped job -status command, it shows:
> {code}
> Uber job : false
> Number of maps: 1
> Number of reduces: 0
> map() completion: 1.0
> reduce() completion: NaN
> Job state: SUCCEEDED
> retired: false
> reason for failure:
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message