hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "MinJi Kim (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (MAPREDUCE-5568) JHS returns invalid string for reducer completion percentage if AM restarts with 0 reducer.
Date Thu, 20 Nov 2014 00:10:34 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-5568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

MinJi Kim updated MAPREDUCE-5568:
---------------------------------
    Attachment: 5568.patch03

I  must have taken too long of a break between generating the patch02 and uploading.  

[16:05:55] hadoop# git apply --check ~/5568.patch03 -v
Checking patch hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/CompletedJob.java...
Checking patch hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/java/org/apache/hadoop/mapreduce/v2/hs/TestJobHistoryEntities.java...
Checking patch hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/resources/job_1416424547277_0002-1416424775281-root-TeraGen-1416424785433-2-0-SUCCEEDED-default-1416424779349.jhist...


> JHS returns invalid string for reducer completion percentage if AM restarts with 0 reducer.
> -------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-5568
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5568
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>    Affects Versions: 2.4.1, 2.5.1
>            Reporter: Jian He
>            Assignee: MinJi Kim
>         Attachments: 5568.patch01, 5568.patch02, 5568.patch03
>
>
> JobCLient shows like:
> {code}
> 13/10/05 16:26:09 INFO mapreduce.Job:  map 100% reduce NaN%
> 13/10/05 16:26:09 INFO mapreduce.Job: Job job_1381015536254_0001 completed successfully
> 13/10/05 16:26:09 INFO mapreduce.Job: Counters: 26
> 	File System Counters
> 		FILE: Number of bytes read=0
> 		FILE: Number of bytes written=76741
> 		FILE: Number of read operations=0
> 		FILE: Number of large read operations=0
> 		FILE: Number of write operations=0
> 		HDFS: Number of bytes read=48
> 		HDFS: Number of bytes written=0
> 		HDFS: Number of read operations=1
> 		HDFS: Number of large read operations=0
> 		HDFS: Number of write operations=0
> {code}
> With mapped job -status command, it shows:
> {code}
> Uber job : false
> Number of maps: 1
> Number of reduces: 0
> map() completion: 1.0
> reduce() completion: NaN
> Job state: SUCCEEDED
> retired: false
> reason for failure:
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message