hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gera Shegalov (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-2934) Improve handling of container's stderr
Date Tue, 09 Dec 2014 18:18:13 GMT

    [ https://issues.apache.org/jira/browse/YARN-2934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14239779#comment-14239779
] 

Gera Shegalov commented on YARN-2934:
-------------------------------------

Hi [~Naganarasimha], yes that's what I meant. Maybe this is specific to the {{DefaultContainerExecutor}}.
When testing on my macbook:
{code}
$ hadoop org.apache.hadoop.mapreduce.SleepJob -Dyarn.app.mapreduce.am.env=JAVA_HOME=/no/jvm/here
-m 1
{code}

All you get: 
{code}
2014-12-09 09:15:00,252 WARN org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor:
Exception from container-launch with container ID: container_1418144997824_0001_01_000001
and exit code: 127
ExitCodeException exitCode=127:
        at org.apache.hadoop.util.Shell.runCommand(Shell.java:544)
        at org.apache.hadoop.util.Shell.run(Shell.java:455)
        at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:721)
        at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
{code}

In the stderr log of the container, you can see the real deal:
{code}
Log Type: stderr
Log Upload Time: Tue Dec 09 09:15:05 -0800 2014
Log Length: 60
/bin/bash: /no/jvm/here/bin/java: No such file or directory
{code}

> Improve handling of container's stderr 
> ---------------------------------------
>
>                 Key: YARN-2934
>                 URL: https://issues.apache.org/jira/browse/YARN-2934
>             Project: Hadoop YARN
>          Issue Type: Improvement
>            Reporter: Gera Shegalov
>            Assignee: Naganarasimha G R
>
> Most YARN applications redirect stderr to some file. That's why when container launch
fails with {{ExitCodeException}} the message is empty.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message