hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Shubham Gupta (Jira)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-7351) CleanupJob during handle of SIGTERM signal
Date Wed, 30 Jun 2021 06:55:00 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-7351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17371848#comment-17371848

Shubham Gupta commented on MAPREDUCE-7351:

Hey , I have uploaded the patch, please have a look! 
We will call the "committer.abortJob(jobContext, State.KILLED);" in MRAppMasterShutdownHook.

I have tested it by killing the jobs and the _temporary files got cleared up.

> CleanupJob during handle of SIGTERM signal
> ------------------------------------------
>                 Key: MAPREDUCE-7351
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7351
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>    Affects Versions: 3.3.0
>            Reporter: Prabhu Joseph
>            Assignee: Prabhu Joseph
>            Priority: Minor
> Currently MR CleanupJob happens when the job is either successful or fail. But during
kill, it is not handled. This leaves all the temporary folders under the output path.

This message was sent by Atlassian Jira

To unsubscribe, e-mail: mapreduce-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-help@hadoop.apache.org

View raw message