hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Vinod Kumar Vavilapalli <vino...@apache.org>
Subject Re: Yarn MapReduce Job Issue - AM Container launch error in Hadoop 2.3.0
Date Sat, 22 Mar 2014 18:11:42 GMT
What is "614" here?

The other relevant thing to check is the MapReduce specific config mapreduce.application.classpath.

+Vinod

On Mar 22, 2014, at 9:03 AM, Tony Mullins <tonymullins.tm@gmail.com> wrote:

> Hi,
> 
> I have setup a 2 node cluster of Hadoop 2.3.0. Its working fine and I can successfully
run distributedshell-2.2.0.jar example. But when I try to run any mapreduce job I get error.
I have setup MapRed.xml and other configs for running MapReduce job according to (http://www.alexjf.net/blog/distributed-systems/hadoop-yarn-installation-definitive-guide)
but I am getting following error :
> 
> 14/03/22 20:31:17 INFO mapreduce.Job: Job job_1395502230567_0001 failed with state FAILED
due to: Application application_1395502230567_0001 failed 2 times due to AM Container for
appattempt_1395502230567_0001_000002 exited with exitCode: 1 due to: Exception from container-launch:
org.apache.hadoop.util.Shell$ExitCodeException: org.apache.hadoop.util.Shell$ExitCodeException:
at org.apache.hadoop.util.Shell.runCommand(Shell.java:505) at org.apache.hadoop.util.Shell.run(Shell.java:418)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:650) at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:283)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:79)
at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:744)
> 
>     Container exited with a non-zero exit code 1
>     .Failing this attempt.. Failing the application.
>     14/03/22 20:31:17 INFO mapreduce.Job: Counters: 0
>     Job ended: Sat Mar 22 20:31:17 PKT 2014
>     The job took 6 seconds.
> And if look at stderr (log of job) there is only one line 
> 
> "Could not find or load main class 614"
> 
> Now I have googled it and usually this issues comes when you have different JAVA versions
or in yarn-site.xml classpath is not properly set , my yarn-site.xml has this
> 
> 
> <property>
>     <name>yarn.application.classpath</name>
>     <value>/opt/yarn/hadoop-2.3.0/etc/hadoop,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*</value>
> 
>   </property>
> So any other ideas what could be the issue here ?
> 
> I am running my mapreduce job like this:
> 
> $HADOOP_PREFIX/bin/hadoop jar $HADOOP_PREFIX/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.2.0.jar
randomwriter out
> Thanks, Tony
> 
> 


-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.

Mime
View raw message