hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Robert Kanter (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-6704) Container fail to launch for mapred application
Date Wed, 21 Sep 2016 18:34:20 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-6704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15510781#comment-15510781
] 

Robert Kanter commented on MAPREDUCE-6704:
------------------------------------------

{quote}Quite shocked that commit "9d4d30243b0fc" get merged without basic MRv2 test and even
no YARN JIRA for it!{quote}
[~tangzhankun], commit "9d4d30243b0fc" when in to fix a security problem.  That's why there's
no JIRA and why it's shrouded in mystery.  

{quote}
Who cares? It's all Apache Hadoop. Users have an expectation that this stuff will work out
of the box and be consistent. They aren't going to say "Oh, of course this is completely broken!
That part over there is YARN and that part over there is MAPREDUCE!"
{quote}
[~aw], my original patch for "9d4d30243b0fc" did add {{HADOOP_MAPRED_HOME}} to Yarn and things
did work out of the box.  There was pushback to remove it because of the desire to keep Yarn
and MR separate.  Given the difficulty people seem to be having and that there doesn't seem
to be a single fix that works for everyone for some reason, perhaps we should revisit that
decision?  


> Container fail to launch for mapred application
> -----------------------------------------------
>
>                 Key: MAPREDUCE-6704
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6704
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>            Reporter: Bibin A Chundatt
>            Assignee: Bibin A Chundatt
>            Priority: Blocker
>         Attachments: 0001-MAPREDUCE-6704.patch, 0001-YARN-5026.patch
>
>
> Container fail to launch for mapred application.
> As part for launch script {{HADOOP_MAPRED_HOME}} default value is not set .After https://github.com/apache/hadoop/commit/9d4d30243b0fc9630da51a2c17b543ef671d035c
  {{HADOOP_MAPRED_HOME}} is not able to get from {{builder.environment()}} since {{DefaultContainerExecutor#buildCommandExecutor}}
sets inherit to false.
> {noformat}
> 16/05/02 09:16:05 INFO mapreduce.Job: Job job_1462155939310_0004 failed with state FAILED
due to: Application application_1462155939310_0004 failed 2 times due to AM Container for
appattempt_1462155939310_0004_000002 exited with  exitCode: 1
> Failing this attempt.Diagnostics: Exception from container-launch.
> Container id: container_1462155939310_0004_02_000001
> Exit code: 1
> Stack trace: ExitCodeException exitCode=1:
>         at org.apache.hadoop.util.Shell.runCommand(Shell.java:946)
>         at org.apache.hadoop.util.Shell.run(Shell.java:850)
>         at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1144)
>         at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:227)
>         at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:385)
>         at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:281)
>         at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:89)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>         at java.lang.Thread.run(Thread.java:745)
> Container exited with a non-zero exit code 1. Last 4096 bytes of stderr :
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option UseSplitVerifier; support
was removed in 8.0
> Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster
> Container exited with a non-zero exit code 1. Last 4096 bytes of stderr :
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option UseSplitVerifier; support
was removed in 8.0
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-help@hadoop.apache.org


Mime
View raw message