hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Varun Vasudev (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (YARN-4309) Add debug information to application logs when a container fails
Date Wed, 02 Dec 2015 09:09:11 GMT

     [ https://issues.apache.org/jira/browse/YARN-4309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Varun Vasudev updated YARN-4309:
    Attachment: YARN-4309.004.patch

Thanks for the review [~sidharta-s].

bq. Could you clarify why the debugging information gathering in DockerContainerExecutor.writeLaunchEnv
is not guarded by a config check?

Good catch. The config check should be present in DockerContainerExecutor as well. Fixed.

bq. There seem to be minor inconsistent line spacing issues in the new test function in TestContainerLaunch.java


I've changed the find command in the latest version to not use the xtype option which seems
to be Linux only. I've also renamed the scriptbuilder functions to indicate that they're meant
for debugging purposes.

> Add debug information to application logs when a container fails
> ----------------------------------------------------------------
>                 Key: YARN-4309
>                 URL: https://issues.apache.org/jira/browse/YARN-4309
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: nodemanager
>            Reporter: Varun Vasudev
>            Assignee: Varun Vasudev
>         Attachments: YARN-4309.001.patch, YARN-4309.002.patch, YARN-4309.003.patch, YARN-4309.004.patch
> Sometimes when a container fails, it can be pretty hard to figure out why it failed.
> My proposal is that if a container fails, we collect information about the container
local dir and dump it into the container log dir. Ideally, I'd like to tar up the directory
entirely, but I'm not sure of the security and space implications of such a approach. At the
very least, we can list all the files in the container local dir, and dump the contents of
launch_container.sh(into the container log dir).
> When log aggregation occurs, all this information will automatically get collected and
make debugging such failures much easier.

This message was sent by Atlassian JIRA

View raw message