Mailing-List: contact common-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: common-issues@hadoop.apache.org
Date: Mon, 17 Oct 2011 09:26:12 +0000 (UTC)
From: "Ahmed Radwan (Updated) (JIRA)" <jira@apache.org>
To: common-issues@hadoop.apache.org
Message-ID: 
 <1041304277.20021.1318843572395.JavaMail.tomcat@hel.zones.apache.org>
In-Reply-To: 
 <964350049.19968.1318842131796.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Updated] (HADOOP-7752) Unable to start yarn services using
 the new hadoop-dist tar stitching module
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable


     [ https://issues.apache.org/jira/browse/HADOOP-7752?page=3Dcom.atlassi=
an.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ahmed Radwan updated HADOOP-7752:
---------------------------------

    Description:=20
Using the maven target: $mvn package -Pdist -DskipTests
I am seeing the following error when trying to start the resourcemanager:
{{
$ bin/yarn-daemon.sh start resourcemanager
starting resourcemanager, logging to /home/ahmed/apache/hadoop-common/hadoo=
p-dist/target/hadoop-0.24.0-SNAPSHOT/bin/../logs/yarn-ahmed-resourcemanager=
-ubuntu.out
/usr/lib/jvm/java-6-sun/bin/java -Dproc_resourcemanager -Xmx1000m -Dhadoop.=
log.dir=3D/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0=
-SNAPSHOT/bin/../logs -Dyarn.log.dir=3D/home/ahmed/apache/hadoop-common/had=
oop-dist/target/hadoop-0.24.0-SNAPSHOT/bin/../logs -Dhadoop.log.file=3Dyarn=
-ahmed-resourcemanager-ubuntu.log -Dyarn.log.file=3Dyarn-ahmed-resourcemana=
ger-ubuntu.log -Dyarn.home.dir=3D/home/ahmed/apache/hadoop-common/hadoop-di=
st/target/hadoop-0.24.0-SNAPSHOT/bin/.. -Dhadoop.root.logger=3DINFO,DRFA -D=
yarn.root.logger=3DINFO,DRFA -classpath /home/ahmed/apache/hadoop-common/ha=
doop-dist/target/hadoop-0.24.0-SNAPSHOT/conf/:~/home/ahmed/apache/hadoop-co=
mmon/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/conf/::/usr/lib/jvm/java-6-s=
un/lib/tools.jar:/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop=
-0.24.0-SNAPSHOT/share/hadoop/common/*:/home/ahmed/apache/hadoop-common/had=
oop-dist/target/hadoop-0.24.0-SNAPSHOT/share/hadoop/common/lib/*:/home/ahme=
d/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/share/hado=
op/hdfs/*:/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0=
-SNAPSHOT/share/hadoop/hdfs/lib/*:/home/ahmed/apache/hadoop-common/hadoop-d=
ist/target/hadoop-0.24.0-SNAPSHOT/bin/../modules/*:/home/ahmed/apache/hadoo=
p-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/bin/../lib/*:~/home/ahme=
d/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/conf//rm-c=
onfig/log4j.properties org.apache.hadoop.yarn.server.resourcemanager.Resour=
ceManager
Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoo=
p/yarn/server/resourcemanager/ResourceManager
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.yarn.server.=
resourcemanager.ResourceManager
=09at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
=09at java.security.AccessController.doPrivileged(Native Method)
=09at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
=09at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
=09at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
=09at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
Could not find the main class: org.apache.hadoop.yarn.server.resourcemanage=
r.ResourceManager.  Program will exit.
}}

Seems there are some missing jars in the modules directory in the dist:

{{
$ ls -al modules/
total 476
drwxr-xr-x  2 ahmed ahmed   4096 2011-10-17 00:56 .
drwxr-xr-x 11 ahmed ahmed   4096 2011-10-17 00:58 ..
-rwxr-xr-x  1 ahmed ahmed 347941 2011-10-17 00:56 hadoop-mapreduce-client-a=
pp-0.24.0-SNAPSHOT.jar
-rwxr-xr-x  1 ahmed ahmed  79364 2011-10-17 00:56 hadoop-mapreduce-client-h=
s-0.24.0-SNAPSHOT.jar
-rwxr-xr-x  1 ahmed ahmed  30720 2011-10-17 00:56 hadoop-mapreduce-client-j=
obclient-0.24.0-SNAPSHOT.jar
-rwxr-xr-x  1 ahmed ahmed  15358 2011-10-17 00:56 hadoop-mapreduce-client-s=
huffle-0.24.0-SNAPSHOT.jar
}}

  was:
Using the maven target: $mvn package -Pdist -DskipTests
I am seeing the following error when trying to start the resourcemanager:

$ bin/yarn-daemon.sh start resourcemanager
starting resourcemanager, logging to /home/ahmed/apache/hadoop-common/hadoo=
p-dist/target/hadoop-0.24.0-SNAPSHOT/bin/../logs/yarn-ahmed-resourcemanager=
-ubuntu.out
/usr/lib/jvm/java-6-sun/bin/java -Dproc_resourcemanager -Xmx1000m -Dhadoop.=
log.dir=3D/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0=
-SNAPSHOT/bin/../logs -Dyarn.log.dir=3D/home/ahmed/apache/hadoop-common/had=
oop-dist/target/hadoop-0.24.0-SNAPSHOT/bin/../logs -Dhadoop.log.file=3Dyarn=
-ahmed-resourcemanager-ubuntu.log -Dyarn.log.file=3Dyarn-ahmed-resourcemana=
ger-ubuntu.log -Dyarn.home.dir=3D/home/ahmed/apache/hadoop-common/hadoop-di=
st/target/hadoop-0.24.0-SNAPSHOT/bin/.. -Dhadoop.root.logger=3DINFO,DRFA -D=
yarn.root.logger=3DINFO,DRFA -classpath /home/ahmed/apache/hadoop-common/ha=
doop-dist/target/hadoop-0.24.0-SNAPSHOT/conf/:~/home/ahmed/apache/hadoop-co=
mmon/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/conf/::/usr/lib/jvm/java-6-s=
un/lib/tools.jar:/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop=
-0.24.0-SNAPSHOT/share/hadoop/common/*:/home/ahmed/apache/hadoop-common/had=
oop-dist/target/hadoop-0.24.0-SNAPSHOT/share/hadoop/common/lib/*:/home/ahme=
d/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/share/hado=
op/hdfs/*:/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0=
-SNAPSHOT/share/hadoop/hdfs/lib/*:/home/ahmed/apache/hadoop-common/hadoop-d=
ist/target/hadoop-0.24.0-SNAPSHOT/bin/../modules/*:/home/ahmed/apache/hadoo=
p-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/bin/../lib/*:~/home/ahme=
d/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/conf//rm-c=
onfig/log4j.properties org.apache.hadoop.yarn.server.resourcemanager.Resour=
ceManager
Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoo=
p/yarn/server/resourcemanager/ResourceManager
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.yarn.server.=
resourcemanager.ResourceManager
=09at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
=09at java.security.AccessController.doPrivileged(Native Method)
=09at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
=09at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
=09at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
=09at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
Could not find the main class: org.apache.hadoop.yarn.server.resourcemanage=
r.ResourceManager.  Program will exit.

Seems there are some missing jars in the modules directory in the dist:
$ ls -al modules/
total 476
drwxr-xr-x  2 ahmed ahmed   4096 2011-10-17 00:56 .
drwxr-xr-x 11 ahmed ahmed   4096 2011-10-17 00:58 ..
-rwxr-xr-x  1 ahmed ahmed 347941 2011-10-17 00:56 hadoop-mapreduce-client-a=
pp-0.24.0-SNAPSHOT.jar
-rwxr-xr-x  1 ahmed ahmed  79364 2011-10-17 00:56 hadoop-mapreduce-client-h=
s-0.24.0-SNAPSHOT.jar
-rwxr-xr-x  1 ahmed ahmed  30720 2011-10-17 00:56 hadoop-mapreduce-client-j=
obclient-0.24.0-SNAPSHOT.jar
-rwxr-xr-x  1 ahmed ahmed  15358 2011-10-17 00:56 hadoop-mapreduce-client-s=
huffle-0.24.0-SNAPSHOT.jar

   =20
> Unable to start yarn services using the new hadoop-dist tar stitching mod=
ule
> -------------------------------------------------------------------------=
---
>
>                 Key: HADOOP-7752
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7752
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 0.23.0, 0.24.0
>            Reporter: Ahmed Radwan
>
> Using the maven target: $mvn package -Pdist -DskipTests
> I am seeing the following error when trying to start the resourcemanager:
> {{
> $ bin/yarn-daemon.sh start resourcemanager
> starting resourcemanager, logging to /home/ahmed/apache/hadoop-common/had=
oop-dist/target/hadoop-0.24.0-SNAPSHOT/bin/../logs/yarn-ahmed-resourcemanag=
er-ubuntu.out
> /usr/lib/jvm/java-6-sun/bin/java -Dproc_resourcemanager -Xmx1000m -Dhadoo=
p.log.dir=3D/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24=
.0-SNAPSHOT/bin/../logs -Dyarn.log.dir=3D/home/ahmed/apache/hadoop-common/h=
adoop-dist/target/hadoop-0.24.0-SNAPSHOT/bin/../logs -Dhadoop.log.file=3Dya=
rn-ahmed-resourcemanager-ubuntu.log -Dyarn.log.file=3Dyarn-ahmed-resourcema=
nager-ubuntu.log -Dyarn.home.dir=3D/home/ahmed/apache/hadoop-common/hadoop-=
dist/target/hadoop-0.24.0-SNAPSHOT/bin/.. -Dhadoop.root.logger=3DINFO,DRFA =
-Dyarn.root.logger=3DINFO,DRFA -classpath /home/ahmed/apache/hadoop-common/=
hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/conf/:~/home/ahmed/apache/hadoop-=
common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/conf/::/usr/lib/jvm/java-6=
-sun/lib/tools.jar:/home/ahmed/apache/hadoop-common/hadoop-dist/target/hado=
op-0.24.0-SNAPSHOT/share/hadoop/common/*:/home/ahmed/apache/hadoop-common/h=
adoop-dist/target/hadoop-0.24.0-SNAPSHOT/share/hadoop/common/lib/*:/home/ah=
med/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/share/ha=
doop/hdfs/*:/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24=
.0-SNAPSHOT/share/hadoop/hdfs/lib/*:/home/ahmed/apache/hadoop-common/hadoop=
-dist/target/hadoop-0.24.0-SNAPSHOT/bin/../modules/*:/home/ahmed/apache/had=
oop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/bin/../lib/*:~/home/ah=
med/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/conf//rm=
-config/log4j.properties org.apache.hadoop.yarn.server.resourcemanager.Reso=
urceManager
> Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/had=
oop/yarn/server/resourcemanager/ResourceManager
> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.yarn.serve=
r.resourcemanager.ResourceManager
> =09at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> =09at java.security.AccessController.doPrivileged(Native Method)
> =09at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> =09at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> =09at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> =09at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> Could not find the main class: org.apache.hadoop.yarn.server.resourcemana=
ger.ResourceManager.  Program will exit.
> }}
> Seems there are some missing jars in the modules directory in the dist:
> {{
> $ ls -al modules/
> total 476
> drwxr-xr-x  2 ahmed ahmed   4096 2011-10-17 00:56 .
> drwxr-xr-x 11 ahmed ahmed   4096 2011-10-17 00:58 ..
> -rwxr-xr-x  1 ahmed ahmed 347941 2011-10-17 00:56 hadoop-mapreduce-client=
-app-0.24.0-SNAPSHOT.jar
> -rwxr-xr-x  1 ahmed ahmed  79364 2011-10-17 00:56 hadoop-mapreduce-client=
-hs-0.24.0-SNAPSHOT.jar
> -rwxr-xr-x  1 ahmed ahmed  30720 2011-10-17 00:56 hadoop-mapreduce-client=
-jobclient-0.24.0-SNAPSHOT.jar
> -rwxr-xr-x  1 ahmed ahmed  15358 2011-10-17 00:56 hadoop-mapreduce-client=
-shuffle-0.24.0-SNAPSHOT.jar
> }}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrato=
rs: https://issues.apache.org/jira/secure/ContactAdministrators!default.jsp=
a
For more information on JIRA, see: http://www.atlassian.com/software/jira