hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tony Mullins <tonymullins...@gmail.com>
Subject Re: Yarn MapReduce Job Issue - AM Container launch error in Hadoop 2.3.0
Date Sun, 23 Mar 2014 13:24:42 GMT
Ok , my bad , I fixed the issue it was due to bad classpaths. I was not
giving complete lib dir paths.

Thanks Vinod for your time & help.

Regards,
Tony


On Sat, Mar 22, 2014 at 11:41 PM, Vinod Kumar Vavilapalli <
vinodkv@apache.org> wrote:

> Given your earlier mail about the paths in /opt, shouldn't mapreduce
> classpath also point to /opt/yarn/hadoop-2.3.0 etc?
>
> +Vinod
>
>
> On Mar 22, 2014, at 11:33 AM, Tony Mullins <tonymullins.tm@gmail.com>
> wrote:
>
> That I also dont know what 614... Its the exact and single line in stderr
> of Jobs logs.
> And regarding MapRed classpath , defaults are good as there are only two
> vars $HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*,
> $HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*.
>
> Is there any other place to look for detailed & meaningfull error info ?
> or any huntch to how to fix it ?
>
> Thanks,
> Tony
>
>
> On Sat, Mar 22, 2014 at 11:11 PM, Vinod Kumar Vavilapalli <
> vinodkv@apache.org> wrote:
>
>> What is "614" here?
>>
>> The other relevant thing to check is the MapReduce specific config
>> mapreduce.application.classpath.
>>
>> +Vinod
>>
>> On Mar 22, 2014, at 9:03 AM, Tony Mullins <tonymullins.tm@gmail.com>
>> wrote:
>>
>> Hi,
>>
>> I have setup a 2 node cluster of Hadoop 2.3.0. Its working fine and I can
>> successfully run distributedshell-2.2.0.jar example. But when I try to run
>> any mapreduce job I get error. I have setup MapRed.xml and other configs
>> for running MapReduce job according to (
>> http://www.alexjf.net/blog/distributed-systems/hadoop-yarn-installation-definitive-guide)
>> but I am getting following error :
>>
>> 14/03/22 20:31:17 INFO mapreduce.Job: Job job_1395502230567_0001 failed
>> with state FAILED due to: Application application_1395502230567_0001 failed
>> 2 times due to AM Container for appattempt_1395502230567_0001_000002 exited
>> with exitCode: 1 due to: Exception from container-launch:
>> org.apache.hadoop.util.Shell$ExitCodeException:
>> org.apache.hadoop.util.Shell$ExitCodeException: at
>> org.apache.hadoop.util.Shell.runCommand(Shell.java:505) at
>> org.apache.hadoop.util.Shell.run(Shell.java:418) at
>> org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:650)
>> at
>> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195)
>> at
>> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:283)
>> at
>> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:79)
>> at java.util.concurrent.FutureTask.run(FutureTask.java:262) at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>> at java.lang.Thread.run(Thread.java:744)
>>
>>     Container exited with a non-zero exit code 1
>>     .Failing this attempt.. Failing the application.
>>     14/03/22 20:31:17 INFO mapreduce.Job: Counters: 0
>>     Job ended: Sat Mar 22 20:31:17 PKT 2014
>>     The job took 6 seconds.
>>
>> And if look at stderr (log of job) there is only one line
>>
>> *"Could not find or load main class 614"*
>>
>> Now I have googled it and usually this issues comes when you have
>> different JAVA versions or in yarn-site.xml classpath is not properly set ,
>> my yarn-site.xml has this
>>
>>
>> <property>
>>     <name>yarn.application.classpath</name>
>>     <value>/opt/yarn/hadoop-2.3.0/etc/hadoop,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*</value>
>>
>>
>>   </property>
>>
>> So any other ideas what could be the issue here ?
>>
>> I am running my mapreduce job like this:
>>
>> $HADOOP_PREFIX/bin/hadoop jar $HADOOP_PREFIX/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.2.0.jar
randomwriter out
>>
>> Thanks, Tony
>>
>>
>>
>> CONFIDENTIALITY NOTICE
>> NOTICE: This message is intended for the use of the individual or entity
>> to which it is addressed and may contain information that is confidential,
>> privileged and exempt from disclosure under applicable law. If the reader
>> of this message is not the intended recipient, you are hereby notified that
>> any printing, copying, dissemination, distribution, disclosure or
>> forwarding of this communication is strictly prohibited. If you have
>> received this communication in error, please contact the sender immediately
>> and delete it from your system. Thank You.
>
>
>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity
> to which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>

Mime
View raw message