hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Amar Kamat (JIRA)" <j...@apache.org>
Subject [jira] [Created] (MAPREDUCE-2511) Progress reported by map tasks of a map-only job is incorrect
Date Wed, 18 May 2011 09:43:47 GMT
Progress reported by map tasks of a map-only job is incorrect
-------------------------------------------------------------

                 Key: MAPREDUCE-2511
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2511
             Project: Hadoop Map/Reduce
          Issue Type: Bug
    Affects Versions: 0.23.0
            Reporter: Amar Kamat


For a map task of a map-reduce job, the progress bar is (logically) split into 2 distinct
phases
1. Map Phase
2. Sort Phase

The map phase manages 66% of the overall tasks progress while the sort phase governs the rest
i.e 33%. 

For a map task of a map-only job, there is no sort phase. Hence the entire map phase should
govern 100% of the task's progress. Currently, the progress bar is split divided into 66%-33%
irrespective of whether the job has reducers or not (i.e whether there is a sort phase or
not).

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message