hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eric Badger (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HADOOP-13709) Clean up subprocesses spawned by Shell.java:runCommand when the shell process exits
Date Fri, 21 Oct 2016 15:08:58 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-13709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Eric Badger updated HADOOP-13709:
    Attachment: HADOOP-13709.003.patch

Thanks for the review, [~daryn]! I addressed your comments and am attaching a patch with a
single shutdown hook that iterates through a WeakHashMap to destroy all child processes. As
before, I tested this out on the localizer using a local cluster with {{sleep}} in the place
of {{untar}}. When the job was killed, the {{sleep}} process was also subsequently killed.

> Clean up subprocesses spawned by Shell.java:runCommand when the shell process exits
> -----------------------------------------------------------------------------------
>                 Key: HADOOP-13709
>                 URL: https://issues.apache.org/jira/browse/HADOOP-13709
>             Project: Hadoop Common
>          Issue Type: Bug
>    Affects Versions: 2.2.0
>            Reporter: Eric Badger
>            Assignee: Eric Badger
>         Attachments: HADOOP-13709.001.patch, HADOOP-13709.002.patch, HADOOP-13709.003.patch
> The runCommand code in Shell.java can get into a situation where it will ignore InterruptedExceptions
and refuse to shutdown due to being in I/O waiting for the return value of the subprocess
that was spawned. We need to allow for the subprocess to be interrupted and killed when the
shell process gets killed. Currently the JVM will shutdown and all of the subprocesses will
be orphaned and not killed.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org

View raw message