hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ahmed Radwan (Updated) (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HADOOP-7752) Unable to start yarn services using the new hadoop-dist tar stitching module
Date Mon, 17 Oct 2011 09:26:12 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-7752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Ahmed Radwan updated HADOOP-7752:
---------------------------------

    Description: 
Using the maven target: $mvn package -Pdist -DskipTests
I am seeing the following error when trying to start the resourcemanager:
{{
$ bin/yarn-daemon.sh start resourcemanager
starting resourcemanager, logging to /home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/bin/../logs/yarn-ahmed-resourcemanager-ubuntu.out
/usr/lib/jvm/java-6-sun/bin/java -Dproc_resourcemanager -Xmx1000m -Dhadoop.log.dir=/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/bin/../logs
-Dyarn.log.dir=/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/bin/../logs
-Dhadoop.log.file=yarn-ahmed-resourcemanager-ubuntu.log -Dyarn.log.file=yarn-ahmed-resourcemanager-ubuntu.log
-Dyarn.home.dir=/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/bin/..
-Dhadoop.root.logger=INFO,DRFA -Dyarn.root.logger=INFO,DRFA -classpath /home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/conf/:~/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/conf/::/usr/lib/jvm/java-6-sun/lib/tools.jar:/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/share/hadoop/common/*:/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/share/hadoop/common/lib/*:/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/share/hadoop/hdfs/*:/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/share/hadoop/hdfs/lib/*:/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/bin/../modules/*:/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/bin/../lib/*:~/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/conf//rm-config/log4j.properties
org.apache.hadoop.yarn.server.resourcemanager.ResourceManager
Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/yarn/server/resourcemanager/ResourceManager
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.yarn.server.resourcemanager.ResourceManager
	at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
	at java.security.AccessController.doPrivileged(Native Method)
	at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
Could not find the main class: org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.
 Program will exit.
}}

Seems there are some missing jars in the modules directory in the dist:

{{
$ ls -al modules/
total 476
drwxr-xr-x  2 ahmed ahmed   4096 2011-10-17 00:56 .
drwxr-xr-x 11 ahmed ahmed   4096 2011-10-17 00:58 ..
-rwxr-xr-x  1 ahmed ahmed 347941 2011-10-17 00:56 hadoop-mapreduce-client-app-0.24.0-SNAPSHOT.jar
-rwxr-xr-x  1 ahmed ahmed  79364 2011-10-17 00:56 hadoop-mapreduce-client-hs-0.24.0-SNAPSHOT.jar
-rwxr-xr-x  1 ahmed ahmed  30720 2011-10-17 00:56 hadoop-mapreduce-client-jobclient-0.24.0-SNAPSHOT.jar
-rwxr-xr-x  1 ahmed ahmed  15358 2011-10-17 00:56 hadoop-mapreduce-client-shuffle-0.24.0-SNAPSHOT.jar
}}

  was:
Using the maven target: $mvn package -Pdist -DskipTests
I am seeing the following error when trying to start the resourcemanager:

$ bin/yarn-daemon.sh start resourcemanager
starting resourcemanager, logging to /home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/bin/../logs/yarn-ahmed-resourcemanager-ubuntu.out
/usr/lib/jvm/java-6-sun/bin/java -Dproc_resourcemanager -Xmx1000m -Dhadoop.log.dir=/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/bin/../logs
-Dyarn.log.dir=/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/bin/../logs
-Dhadoop.log.file=yarn-ahmed-resourcemanager-ubuntu.log -Dyarn.log.file=yarn-ahmed-resourcemanager-ubuntu.log
-Dyarn.home.dir=/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/bin/..
-Dhadoop.root.logger=INFO,DRFA -Dyarn.root.logger=INFO,DRFA -classpath /home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/conf/:~/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/conf/::/usr/lib/jvm/java-6-sun/lib/tools.jar:/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/share/hadoop/common/*:/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/share/hadoop/common/lib/*:/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/share/hadoop/hdfs/*:/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/share/hadoop/hdfs/lib/*:/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/bin/../modules/*:/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/bin/../lib/*:~/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/conf//rm-config/log4j.properties
org.apache.hadoop.yarn.server.resourcemanager.ResourceManager
Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/yarn/server/resourcemanager/ResourceManager
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.yarn.server.resourcemanager.ResourceManager
	at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
	at java.security.AccessController.doPrivileged(Native Method)
	at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
Could not find the main class: org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.
 Program will exit.

Seems there are some missing jars in the modules directory in the dist:
$ ls -al modules/
total 476
drwxr-xr-x  2 ahmed ahmed   4096 2011-10-17 00:56 .
drwxr-xr-x 11 ahmed ahmed   4096 2011-10-17 00:58 ..
-rwxr-xr-x  1 ahmed ahmed 347941 2011-10-17 00:56 hadoop-mapreduce-client-app-0.24.0-SNAPSHOT.jar
-rwxr-xr-x  1 ahmed ahmed  79364 2011-10-17 00:56 hadoop-mapreduce-client-hs-0.24.0-SNAPSHOT.jar
-rwxr-xr-x  1 ahmed ahmed  30720 2011-10-17 00:56 hadoop-mapreduce-client-jobclient-0.24.0-SNAPSHOT.jar
-rwxr-xr-x  1 ahmed ahmed  15358 2011-10-17 00:56 hadoop-mapreduce-client-shuffle-0.24.0-SNAPSHOT.jar

    
> Unable to start yarn services using the new hadoop-dist tar stitching module
> ----------------------------------------------------------------------------
>
>                 Key: HADOOP-7752
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7752
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 0.23.0, 0.24.0
>            Reporter: Ahmed Radwan
>
> Using the maven target: $mvn package -Pdist -DskipTests
> I am seeing the following error when trying to start the resourcemanager:
> {{
> $ bin/yarn-daemon.sh start resourcemanager
> starting resourcemanager, logging to /home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/bin/../logs/yarn-ahmed-resourcemanager-ubuntu.out
> /usr/lib/jvm/java-6-sun/bin/java -Dproc_resourcemanager -Xmx1000m -Dhadoop.log.dir=/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/bin/../logs
-Dyarn.log.dir=/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/bin/../logs
-Dhadoop.log.file=yarn-ahmed-resourcemanager-ubuntu.log -Dyarn.log.file=yarn-ahmed-resourcemanager-ubuntu.log
-Dyarn.home.dir=/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/bin/..
-Dhadoop.root.logger=INFO,DRFA -Dyarn.root.logger=INFO,DRFA -classpath /home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/conf/:~/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/conf/::/usr/lib/jvm/java-6-sun/lib/tools.jar:/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/share/hadoop/common/*:/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/share/hadoop/common/lib/*:/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/share/hadoop/hdfs/*:/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/share/hadoop/hdfs/lib/*:/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/bin/../modules/*:/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/bin/../lib/*:~/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/conf//rm-config/log4j.properties
org.apache.hadoop.yarn.server.resourcemanager.ResourceManager
> Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/yarn/server/resourcemanager/ResourceManager
> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.yarn.server.resourcemanager.ResourceManager
> 	at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> 	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> Could not find the main class: org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.
 Program will exit.
> }}
> Seems there are some missing jars in the modules directory in the dist:
> {{
> $ ls -al modules/
> total 476
> drwxr-xr-x  2 ahmed ahmed   4096 2011-10-17 00:56 .
> drwxr-xr-x 11 ahmed ahmed   4096 2011-10-17 00:58 ..
> -rwxr-xr-x  1 ahmed ahmed 347941 2011-10-17 00:56 hadoop-mapreduce-client-app-0.24.0-SNAPSHOT.jar
> -rwxr-xr-x  1 ahmed ahmed  79364 2011-10-17 00:56 hadoop-mapreduce-client-hs-0.24.0-SNAPSHOT.jar
> -rwxr-xr-x  1 ahmed ahmed  30720 2011-10-17 00:56 hadoop-mapreduce-client-jobclient-0.24.0-SNAPSHOT.jar
> -rwxr-xr-x  1 ahmed ahmed  15358 2011-10-17 00:56 hadoop-mapreduce-client-shuffle-0.24.0-SNAPSHOT.jar
> }}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

       

Mime
View raw message