hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-14846) Wrong shell exit code if the shell process cannot be even started
Date Mon, 11 Sep 2017 10:17:00 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-14846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161023#comment-16161023
] 

Steve Loughran commented on HADOOP-14846:
-----------------------------------------

OK, I see. Even though there was an exit code lower down of 2, the exit code which got all
the way up was 0? Is that what you are seeing.

if so, yes, that needs to be stamped on. Ideally though, by propagating whatever exit code
came up from the launch

> Wrong shell exit code if the shell process cannot be even started
> -----------------------------------------------------------------
>
>                 Key: HADOOP-14846
>                 URL: https://issues.apache.org/jira/browse/HADOOP-14846
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: util
>    Affects Versions: 2.7.1
>            Reporter: Yuqi Wang
>              Labels: shell
>             Fix For: 3.0.0-alpha4
>
>         Attachments: HADOOP-14846.001.patch, HADOOP-14846.002.patch
>
>
> *Hadoop may hide shell failures (including start container and fs operation failures),
such as:*
> Container exit diagnostics (note the container exit code is 0):
> {code:java}
> Exception from container-launch. Container id: container_e5620_1503888150197_2979_01_003320
> Exit code: 0
> Exception message: 
>   Cannot run program "D:\data\hadoop.latest\bin\winutils.exe" (in directory "\data\yarnnm\local\usercache\hadoop\appcache\application_1503888150197_2979\container_e5620_1503888150197_2979_01_003320"):

>   CreateProcess error=2, The system cannot find the file specified
>   Stack trace: java.io.IOException: Cannot run program "D:\data\hadoop.latest\bin\winutils.exe"
(in directory "\data\yarnnm\local\usercache\hadoop\appcache\application_1503888150197_2979\container_e5620_1503888150197_2979_01_003320"):
CreateProcess error=2, The system cannot find the file specified
>     at java.lang.ProcessBuilder.start(ProcessBuilder.java:1048)
>     at org.apache.hadoop.util.Shell.runCommand(Shell.java:517)
>     at org.apache.hadoop.util.Shell.run(Shell.java:490)
>     at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:756)
>     at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:212)
>     at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:329)
>     at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:86)
>     at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>     at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>     at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>     at java.lang.Thread.run(Thread.java:745)
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message