hadoop-yarn-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tsuyoshi Ozawa <oz...@apache.org>
Subject Re: Failure to submit job on trunk hadoop cluster
Date Mon, 27 Jun 2016 12:39:47 GMT
Hey Sunil and Rohith,

Thanks a lot! As you mentioned, it works well after configuring
mapreduce.admin.user.env and yarn.app.mapreduce.am.env.

As Sangjin also mentioned on MAPREDUCE-6704, it's better to configure
mapred.child.env instead of mapreduce.admin.user.env until the problem
described here is fixed:
 https://issues.apache.org/jira/browse/MAPREDUCE-6704?focusedCommentId=15285068&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-15285068

Thanks,
- Tsuyoshi

On Mon, Jun 27, 2016 at 4:32 AM, Rohith Sharma K S
<rohithsharmaks@huawei.com> wrote:
> Hi Tsuyoshi
>
> I think it is modified for security reasons. I too did not find any JIRA id corresponding
to this commit.
>
> Related discussion happened in the following JIRA. https://issues.apache.org/jira/browse/MAPREDUCE-6704
>
>
> Thanks & Regards
> Rohith Sharma K S
>
>
> -----Original Message-----
> From: Tsuyoshi Ozawa [mailto:ozawa@apache.org]
> Sent: 27 June 2016 16:10
> To: common-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; mapreduce-dev@hadoop.apache.org
> Subject: Failure to submit job on trunk hadoop cluster
>
> Hi,
>
> Have anyone tried to submit jobs on trunk cluster?
> I failed to launch jobs by class not found error with following error messages. Should
I change environment variables to setup from branch-2's one? I'm using the same configuration
as Hadoop 2 can run.
>
> $ hadoop jar ./share/hadoop/mapreduce/hadoop-mapreduce-examples-3.0.0-alpha1-SNAPSHOT.jar
> randomtextwriter 2
>
> -> error
>
> $ yarn logs -applicationId application_1467022691488_0004 ...
>
> Exit code: 1
> Stack trace: ExitCodeException exitCode=1:
>         at org.apache.hadoop.util.Shell.runCommand(Shell.java:946)
>                                       at
> org.apache.hadoop.util.Shell.run(Shell.java:850)
>         at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1144)
>         at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:238)
>         at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:385)
>         at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:281)
>         at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:89)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>         at java.lang.Thread.run(Thread.java:745)
> Container exited with a non-zero exit code 1. Last 4096 bytes of stderr :
> Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster
> Container exited with a non-zero exit code 1. Last 4096 bytes of stderr :
> Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster
>
> Thanks,
> - Tsuyoshi
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org


Mime
View raw message