hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Amar Kamat (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-2492) [MAPREDUCE] The new MapReduce API should make available task's progress to the task
Date Mon, 23 May 2011 17:58:47 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-2492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13038094#comment-13038094
] 

Amar Kamat commented on MAPREDUCE-2492:
---------------------------------------

Tom,
The patch (v1.3) was reviewed by Chris and only few minor testcase changes were suggested
(see http://tinyurl.com/mr-2492-review-comments). I incorporated those changes in the latest
patch (v1.7). 

W.r.t to the title, I was under the impression that the old mapred API provides some indicator
to the task's overall progress. Later during the code review I figured out that the older
mapred API provides no such mechanism. 

I think it makes sense to have Reporter provide the task's progress to the map/reduce task
attempts. I would prefer marking this change as incompatible.

Thoughts?

> [MAPREDUCE] The new MapReduce API should make available task's progress to the task
> -----------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-2492
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2492
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: task
>    Affects Versions: 0.23.0
>            Reporter: Amar Kamat
>            Assignee: Amar Kamat
>             Fix For: 0.23.0
>
>         Attachments: MAPREDUCE-2492-v1.3.patch, MAPREDUCE-2492-v1.4.patch, MAPREDUCE-2492-v1.5.patch,
MAPREDUCE-2492-v1.6.patch, MAPREDUCE-2492-v1.7.patch
>
>
> There is no way to get the task's current progress in the new MapReduce API. It would
be nice to make it available so that the task (map/reduce) can use it. 

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message