hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (YARN-6330) DefaultContainerExecutor container launch fails if script dest dir has a space in the path
Date Mon, 13 Mar 2017 15:15:41 GMT

     [ https://issues.apache.org/jira/browse/YARN-6330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Steve Loughran updated YARN-6330:
---------------------------------
    Attachment: YARN-6330-001.patch

patch 001. Doesn't fix it completely; stops the two patched commands from failing, but the
existing (quoted) exec command fails
{code}
2017-03-13 15:03:36,586 [main] INFO  mapreduce.Job (Job.java:monitorAndPrintJob(1434)) - Job
job_1489417410136_0001 failed with state FAILED due to: Application application_1489417410136_0001
failed 2 times due to AM Container for appattempt_1489417410136_0001_000002 exited with  exitCode:
1
Failing this attempt.Diagnostics: Exception from container-launch.
Container id: container_1489417410136_0001_02_000001
Exit code: 1
Exception message: /bin/bash: /Users/stevel/Projects/IDE: Is a directory

Stack trace: ExitCodeException exitCode=1: /bin/bash: /Users/stevel/Projects/IDE: Is a directory

	at org.apache.hadoop.util.Shell.runCommand(Shell.java:994)
	at org.apache.hadoop.util.Shell.run(Shell.java:887)
	at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1212)
	at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:293)
	at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:421)
	at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:283)
	at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:89)
{code}

Given it's already quoted there, I'm not sure what else is to be done. This is a mac BTW,
setsid isn't present, so the command will be one of {{exec bash "temp.sh"}}

> DefaultContainerExecutor container launch fails if script dest dir has a space in the
path
> ------------------------------------------------------------------------------------------
>
>                 Key: YARN-6330
>                 URL: https://issues.apache.org/jira/browse/YARN-6330
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: nodemanager
>    Affects Versions: 2.8.0
>            Reporter: Steve Loughran
>            Priority: Minor
>         Attachments: YARN-6330-001.patch
>
>
> I know there's a workaround "don't do that"; this surfaced in IDE-executed test runs.
> If you have a filesystem where the temp or final launcher script has a space in the path,
set up (echo, mv) fails. If you fix those command setups with the relevant quotes, it fails
in the setsuid script



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message