hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hemanth Yamijala (JIRA)" <j...@apache.org>
Subject [jira] Commented: (MAPREDUCE-947) OutputCommitter should have an abortJob method
Date Mon, 05 Oct 2009 11:15:31 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12762152#action_12762152
] 

Hemanth Yamijala commented on MAPREDUCE-947:
--------------------------------------------

I had a discussion with Amar on the last comment. It appears that some of us had considered
the option of changing the task promotion technique and decided against it, as it would be
an incompatible change. The same applies for changing the signature of cleanupJob. From that
perspective, maybe we should stay the original course of this JIRA.

However, it may be OK to consider whether we want to future-proof ourselves a little bit and
think about ways by which users can distinguish failed and killed jobs in addition to successful
jobs. This can possibly be done in a backward compatible manner by introducing a parameter
to the abortJob. I am not sure if the use case exists for this requirement, but if we can
think of one, it may be better to fix it now rather than latter. Thoughts ?



> OutputCommitter should have an abortJob method
> ----------------------------------------------
>
>                 Key: MAPREDUCE-947
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-947
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>            Reporter: Owen O'Malley
>            Assignee: Amar Kamat
>             Fix For: 0.21.0
>
>         Attachments: mapred-948-v1.2.patch, mapred-948-v1.3.patch, mapred-948-v1.4.patch
>
>
> The OutputCommitter needs an abortJob method to clean up from failed jobs. Currently
there is no way to distinguish between failed or succeeded jobs, making it impossible to write
output promotion code.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message