hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (YARN-6330) DefaultContainerExecutor container launch fails if script dest dir has a space in the path
Date Mon, 13 Mar 2017 15:15:41 GMT

     [ https://issues.apache.org/jira/browse/YARN-6330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Steve Loughran updated YARN-6330:
    Attachment: YARN-6330-001.patch

patch 001. Doesn't fix it completely; stops the two patched commands from failing, but the
existing (quoted) exec command fails
2017-03-13 15:03:36,586 [main] INFO  mapreduce.Job (Job.java:monitorAndPrintJob(1434)) - Job
job_1489417410136_0001 failed with state FAILED due to: Application application_1489417410136_0001
failed 2 times due to AM Container for appattempt_1489417410136_0001_000002 exited with  exitCode:
Failing this attempt.Diagnostics: Exception from container-launch.
Container id: container_1489417410136_0001_02_000001
Exit code: 1
Exception message: /bin/bash: /Users/stevel/Projects/IDE: Is a directory

Stack trace: ExitCodeException exitCode=1: /bin/bash: /Users/stevel/Projects/IDE: Is a directory

	at org.apache.hadoop.util.Shell.runCommand(Shell.java:994)
	at org.apache.hadoop.util.Shell.run(Shell.java:887)
	at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1212)
	at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:293)
	at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:421)
	at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:283)
	at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:89)

Given it's already quoted there, I'm not sure what else is to be done. This is a mac BTW,
setsid isn't present, so the command will be one of {{exec bash "temp.sh"}}

> DefaultContainerExecutor container launch fails if script dest dir has a space in the
> ------------------------------------------------------------------------------------------
>                 Key: YARN-6330
>                 URL: https://issues.apache.org/jira/browse/YARN-6330
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: nodemanager
>    Affects Versions: 2.8.0
>            Reporter: Steve Loughran
>            Priority: Minor
>         Attachments: YARN-6330-001.patch
> I know there's a workaround "don't do that"; this surfaced in IDE-executed test runs.
> If you have a filesystem where the temp or final launcher script has a space in the path,
set up (echo, mv) fails. If you fix those command setups with the relevant quotes, it fails
in the setsuid script

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org

View raw message