giraph-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Meena Rajani <meenakraj...@gmail.com>
Subject error starting MRAppmaster caused by java.lang.ClassNotFoundException: org.apache.hadoop.conf.Configuration$DeprecationDelta
Date Thu, 19 Nov 2015 12:56:35 GMT
I have hadoop 2.2 and running
giraph-examples-1.2.0-SNAPSHOT-for-hadoop-2.6.0-jar-with-dependencies.jar  org.apache.giraph.examples.SimpleShortestPathsComputation.

I had installed hadoop 2.2 long ago so just installed Apache Giraph
recently, with 
 mvn -Phadoop_yarn -Dhadoop.version=2.6.0 package
The Giraph-Dist package failed.
I gathered that it may not be required to run above example.

While running above example I am getting following error 
 
error starting MRAppmaster caused by java.lang.ClassNotFoundException:
org.apache.hadoop.conf.Configuration$DeprecationDelta

I have tried set path in various ways. I have added env var in .bachrc.
I also modified the yarn-site.xml file with
 <name>yarn.application.classpath</name>
        <value>/usr/local/hadoop/etc/hadoop,
        /usr/hadoop/hadoop/*,
        /usr/local/hadoop/lib/*,
        /usr/local/hadoop/share/hadoop/hdfs/*,
        /usr/local/hadoop/share/hadoop/hdfs/lib/*,
        /usr/local/hadoop/share/hadoop/mapreduce/*,
        /usr/local/hadoop/share/hadoop/mapreduce/lib/*,
        /usr/local/hadoop/share/hadoop/yarn/*,
        /usr/local/hadoop/share/hadoop/yarn/lib/*
 
 

Log at container

015-11-19 06:59:22,355 INFO [main]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Created MRAppMaster for
application appattempt_1447933020638_0002_000001
2015-11-19 06:59:22,411 FATAL [main]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Error starting
MRAppMaster
java.lang.NoClassDefFoundError: org/apache/hadoop/conf/Configuration
$DeprecationDelta
	at
org.apache.hadoop.yarn.conf.YarnConfiguration.addDeprecatedKeys(YarnConfiguration.java:79)
	at
org.apache.hadoop.yarn.conf.YarnConfiguration.<clinit>(YarnConfiguration.java:73)
	at
org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1356)
Caused by: java.lang.ClassNotFoundException:
org.apache.hadoop.conf.Configuration$DeprecationDelta
	at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
	at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
	at java.security.AccessController.doPrivileged(Native Method)
	at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
	... 3 more
2015-11-19 06:59:22,437 INFO [Thread-1]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: MRAppMaster received a
signal. Signaling RMCommunicator and JobHistoryEventHandler.


log at terminal 
15/11/19 07:33:47 INFO utils.ConfigurationUtils: No edge input format
specified. Ensure your InputFormat does not require one.
15/11/19 07:33:47 INFO utils.ConfigurationUtils: No edge output format
specified. Ensure your OutputFormat does not require one.
15/11/19 07:33:48 INFO Configuration.deprecation:
mapreduce.job.counters.limit is deprecated. Instead, use
mapreduce.job.counters.max
15/11/19 07:33:48 INFO Configuration.deprecation:
mapred.job.map.memory.mb is deprecated. Instead, use
mapreduce.map.memory.mb
15/11/19 07:33:48 INFO Configuration.deprecation:
mapred.job.reduce.memory.mb is deprecated. Instead, use
mapreduce.reduce.memory.mb
15/11/19 07:33:48 INFO Configuration.deprecation:
mapred.map.tasks.speculative.execution is deprecated. Instead, use
mapreduce.map.speculative
15/11/19 07:33:48 INFO Configuration.deprecation:
mapreduce.user.classpath.first is deprecated. Instead, use
mapreduce.job.user.classpath.first
15/11/19 07:33:48 INFO Configuration.deprecation:
mapred.map.max.attempts is deprecated. Instead, use
mapreduce.map.maxattempts
15/11/19 07:33:48 INFO job.GiraphJob: run: Since checkpointing is
disabled (default), do not allow any task retries (setting
mapred.map.max.attempts = 1, old value = 4)
15/11/19 07:33:48 INFO Configuration.deprecation: mapred.job.tracker is
deprecated. Instead, use mapreduce.jobtracker.address
15/11/19 07:33:48 INFO client.RMProxy: Connecting to ResourceManager
at /0.0.0.0:8032
15/11/19 07:33:49 INFO mapreduce.JobSubmitter: number of splits:2
15/11/19 07:33:49 INFO Configuration.deprecation: user.name is
deprecated. Instead, use mapreduce.job.user.name
15/11/19 07:33:49 INFO Configuration.deprecation: mapred.jar is
deprecated. Instead, use mapreduce.job.jar
15/11/19 07:33:49 INFO Configuration.deprecation: mapred.reduce.tasks is
deprecated. Instead, use mapreduce.job.reduces
15/11/19 07:33:49 INFO Configuration.deprecation: mapreduce.map.class is
deprecated. Instead, use mapreduce.job.map.class
15/11/19 07:33:49 INFO Configuration.deprecation: mapred.job.name is
deprecated. Instead, use mapreduce.job.name
15/11/19 07:33:49 INFO Configuration.deprecation:
mapreduce.inputformat.class is deprecated. Instead, use
mapreduce.job.inputformat.class
15/11/19 07:33:49 INFO Configuration.deprecation: mapred.output.dir is
deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
15/11/19 07:33:49 INFO Configuration.deprecation:
mapreduce.outputformat.class is deprecated. Instead, use
mapreduce.job.outputformat.class
15/11/19 07:33:49 INFO Configuration.deprecation: mapred.map.tasks is
deprecated. Instead, use mapreduce.job.maps
15/11/19 07:33:49 INFO Configuration.deprecation: mapred.working.dir is
deprecated. Instead, use mapreduce.job.working.dir
15/11/19 07:33:50 INFO mapreduce.JobSubmitter: Submitting tokens for
job: job_1447936348317_0001
15/11/19 07:33:50 INFO impl.YarnClientImpl: Submitted application
application_1447936348317_0001 to ResourceManager at /0.0.0.0:8032
15/11/19 07:33:50 INFO mapreduce.Job: The url to track the job:
http://localhost.localdomain:8088/proxy/application_1447936348317_0001/
15/11/19 07:33:50 INFO job.GiraphJob: Tracking URL:
http://localhost.localdomain:8088/proxy/application_1447936348317_0001/
15/11/19 07:33:50 INFO job.GiraphJob: Waiting for resources... Job will
start only when it gets all 2 mappers
15/11/19 07:33:57 INFO mapreduce.Job: Running job:
job_1447936348317_0001
15/11/19 07:33:57 INFO mapreduce.Job: Job job_1447936348317_0001 running
in uber mode : false
15/11/19 07:33:57 INFO mapreduce.Job:  map 0% reduce 0%
15/11/19 07:33:57 INFO mapreduce.Job: Job job_1447936348317_0001 failed
with state FAILED due to: Application application_1447936348317_0001
failed 2 times due to AM Container for
appattempt_1447936348317_0001_000002 exited with  exitCode: 1 due to:
Exception from container-launch: 
org.apache.hadoop.util.Shell$ExitCodeException: 
	at org.apache.hadoop.util.Shell.runCommand(Shell.java:464)
	at org.apache.hadoop.util.Shell.run(Shell.java:379)
	at org.apache.hadoop.util.Shell
$ShellCommandExecutor.execute(Shell.java:589)
	at
org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195)
	at
org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:283)
	at
org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:79)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)


Thanks

Meena




Mime
View raw message