hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jason Lowe (Updated) (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (MAPREDUCE-3862) Nodemanager can appear to hang on shutdown due to lingering DeletionService threads
Date Wed, 15 Feb 2012 21:05:00 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-3862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Jason Lowe updated MAPREDUCE-3862:

    Attachment: MAPREDUCE-3862.patch

Patch to call setExecuteExistingDelayedTasksAfterShutdownPolicy() on init and fallback to
shutdownNow() if ScheduledThreadPoolExecutor.awaitTermination() fails.
> Nodemanager can appear to hang on shutdown due to lingering DeletionService threads
> -----------------------------------------------------------------------------------
>                 Key: MAPREDUCE-3862
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3862
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2, nodemanager
>    Affects Versions: 0.23.1
>            Reporter: Jason Lowe
>         Attachments: MAPREDUCE-3862.patch
> When a nodemanager attempts to shutdown cleanly, it's possible for it to appear to hang
due to lingering DeletionService threads.  This can occur when yarn.nodemanager.delete.debug-delay-sec
is set to a relatively large value and one or more containers executes on the node shortly
before the shutdown.
> The DeletionService is never calling {{setExecuteExistingDelayedTasksAfterShutdownPolicy()}}
on the ScheduledThreadPoolExecutor, and it defaults to waiting for all scheduled tasks to
complete before exiting.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message