hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bibin A Chundatt (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-4463) Container launch failure when yarn.nodemanager.log-dirs directory path contains space
Date Thu, 17 Dec 2015 16:21:46 GMT

    [ https://issues.apache.org/jira/browse/YARN-4463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062262#comment-15062262
] 

Bibin A Chundatt commented on YARN-4463:
----------------------------------------

Hi [~rohithsharma] thank you for looking into the issue .

Escaping should work havn't tested it yet . 

{noformat}
-Dyarn.app.container.log.dir=<PATH>/container\ logs/application_1450332140888_0007/container_1450332140888_0007_01_000063
-Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Dhadoop.root.logfile=syslog
org.apache.hadoop.mapred.YarnChild <ip port > attempt_1450332140888_0007_m_000007_2
63 1><PATH>/container\ logs/application_1450332140888_0007/container_1450332140888_0007_01_000063/stdout
2><PATH>/container\ logs/application_1450332140888_0007/container_1450332140888_0007_01_000063/stderr
{noformat}

The paths mentioned above "\ " we could use in unix if path contains space . Will upload a
patch soon.
Any other solution?

> Container launch failure when yarn.nodemanager.log-dirs directory path contains space
> -------------------------------------------------------------------------------------
>
>                 Key: YARN-4463
>                 URL: https://issues.apache.org/jira/browse/YARN-4463
>             Project: Hadoop YARN
>          Issue Type: Bug
>            Reporter: Bibin A Chundatt
>            Assignee: Bibin A Chundatt
>
> If the container log directory path contains space container-launch fails
> Even with DEBUG logs are enabled only log able to get is 
> {noformat}
> Container id: container_e32_1450233925719_0009_01_000022
> Exit code: 1
> Stack trace: ExitCodeException exitCode=1:
>         at org.apache.hadoop.util.Shell.runCommand(Shell.java:912)
>         at org.apache.hadoop.util.Shell.run(Shell.java:823)
>         at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1102)
>         at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:225)
>         at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:304)
>         at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:84)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>         at java.lang.Thread.run(Thread.java:745)
> {noformat}
> We can support container-launch to support nmlog directory path with space.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message