hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eric Badger (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (YARN-5641) Localizer leaves behind tarballs after container is complete
Date Fri, 16 Dec 2016 17:07:59 GMT

     [ https://issues.apache.org/jira/browse/YARN-5641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Eric Badger updated YARN-5641:
------------------------------
    Attachment: YARN-5641.005.patch

[~jlowe], since HADOOP-13709 was committed, we can add in the localizer-specific piece. Here's
a patch that attempts to shutdown the thread pool threads, kills all subprocesses, and then
waits for the thread pool threads to terminate. If they do not terminate in 10 seconds, then
we will call System.exit() to force the shutdown hook to be invoked, which will call destroyAllProcesses()
again to make sure that all of the spawned subprocesses have been killed. 

> Localizer leaves behind tarballs after container is complete
> ------------------------------------------------------------
>
>                 Key: YARN-5641
>                 URL: https://issues.apache.org/jira/browse/YARN-5641
>             Project: Hadoop YARN
>          Issue Type: Bug
>            Reporter: Eric Badger
>            Assignee: Eric Badger
>         Attachments: YARN-5641.001.patch, YARN-5641.002.patch, YARN-5641.003.patch, YARN-5641.004.patch,
YARN-5641.005.patch
>
>
> The localizer sometimes fails to clean up extracted tarballs leaving large footprints
that persist on the nodes indefinitely. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message