hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Devaraj k <devara...@huawei.com>
Subject RE: java.lang.NoClassDefFoundError: org/apache/hadoop/mapreduce/v2/app/MRAppMaste
Date Tue, 05 Jun 2012 11:56:14 GMT
Hi Subroto,

I am not sure what is happening in your case.

If you have a chance, Can you chech the classpath written in launch_container.sh file in "nmloaldir/nmPrivate/appid/"
before exiting the mrappmaster process.



From: Subroto [ssanyal@datameer.com]
Sent: Tuesday, June 05, 2012 3:55 PM
To: mapreduce-user@hadoop.apache.org
Subject: Re: java.lang.NoClassDefFoundError: org/apache/hadoop/mapreduce/v2/app/MRAppMaste

Hi Deva,

Tried the yarn application path with absolute values. Still it didn't work.  It failed with
same stack trace:-(
Now the value of yarn.application.classpath was:

Subroto Sanyal
On Jun 5, 2012, at 12:07 PM, Devaraj k wrote:

Hi Subroto,

    It will not use yarn-env.sh for launching the application master. NM uses the environment
set by the client for launching application master.  Can you set the environment variables
in /etc/profile or update the yarn application classpath with the absolute paths.

From: Subroto [ssanyal@datameer.com<mailto:ssanyal@datameer.com>]
Sent: Tuesday, June 05, 2012 2:25 PM
To: mapreduce-user@hadoop.apache.org<mailto:mapreduce-user@hadoop.apache.org>
Subject: Re: java.lang.NoClassDefFoundError: org/apache/hadoop/mapreduce/v2/app/MRAppMaste

Hi Deva,

Thanks for your response.
The file etc/hadoop/yarn-env.sh has the following entries:
export HADOOP_MAPRED_HOME=/usr/local/hadoop
export HADOOP_COMMON_HOME=/usr/local/hadoop
export HADOOP_HDFS_HOME=/usr/local/hadoop
export YARN_HOME=/usr/local/hadoop
export HADOOP_CONF_DIR=/usr/local/hadoop/etc/hadoop

Is it expected to have these variables in profile file of the Linux user??

I am not using Windows client. My client is running on Mac and the cluster is running on Linux

Subroto Sanyal
On Jun 5, 2012, at 10:50 AM, Devaraj k wrote:

Can you check all the hadoop environment variables are set properly in which the app master
is getting launching.

If you are submitting from windows, this might be the issue https://issues.apache.org/jira/browse/MAPREDUCE-4052.

From: Subroto [ssanyal@datameer.com<mailto:ssanyal@datameer.com>]
Sent: Tuesday, June 05, 2012 2:14 PM
To: mapreduce-user@hadoop.apache.org<mailto:mapreduce-user@hadoop.apache.org>
Subject: java.lang.NoClassDefFoundError: org/apache/hadoop/mapreduce/v2/app/MRAppMaste


While running MR Jobs over a yarn cluster I  keep on getting:

Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/mapreduce/v2/app/MRAppMaster
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.mapreduce.v2.app.MRAppMaster
        at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:248)
Could not find the main class: org.apache.hadoop.mapreduce.v2.app.MRAppMaster.  Program will

My client is running from a different environment from where the cluster is running.
If I submit a job from the cluster environment; it runs successfully.

I have verified the property yarn.application.classpath before submitting it from the client.
The value is set to:

Please let me know if I am missing anything.

Subroto Sanyal

View raw message