hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andre Kelpe <ake...@concurrentinc.com>
Subject [yarn] job is not getting assigned
Date Thu, 29 Aug 2013 14:52:52 GMT

I am in the middle of setting up a hadoop 2 cluster. I am using the hadoop
2.1-beta tarball.

My cluster has 1 master node running the hdfs namenode, the resourcemanger
and the job history server. Next to that I have  3 nodes acting as
datanodes and nodemanagers.

In order to test, if everything is working, I submitted the teragen job
from the hadoop-examples jar like this:

$ hadoop jar
teragen 1000 /user/vagrant/teragen

The job starts up and I  get the following output:

13/08/29 14:42:46 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
13/08/29 14:42:47 INFO client.RMProxy: Connecting to ResourceManager at
13/08/29 14:42:48 INFO terasort.TeraSort: Generating 1000 using 2
13/08/29 14:42:48 INFO mapreduce.JobSubmitter: number of splits:2
13/08/29 14:42:48 WARN conf.Configuration: user.name is deprecated.
Instead, use mapreduce.job.user.name
13/08/29 14:42:48 WARN conf.Configuration: mapred.jar is deprecated.
Instead, use mapreduce.job.jar
13/08/29 14:42:48 WARN conf.Configuration: mapred.reduce.tasks is
deprecated. Instead, use mapreduce.job.reduces
13/08/29 14:42:48 WARN conf.Configuration: mapred.output.value.class is
deprecated. Instead, use mapreduce.job.output.value.class
13/08/29 14:42:48 WARN conf.Configuration: mapreduce.map.class is
deprecated. Instead, use mapreduce.job.map.class
13/08/29 14:42:48 WARN conf.Configuration: mapred.job.name is deprecated.
Instead, use mapreduce.job.name
13/08/29 14:42:48 WARN conf.Configuration: mapreduce.inputformat.class is
deprecated. Instead, use mapreduce.job.inputformat.class
13/08/29 14:42:48 WARN conf.Configuration: mapred.output.dir is deprecated.
Instead, use mapreduce.output.fileoutputformat.outputdir
13/08/29 14:42:48 WARN conf.Configuration: mapreduce.outputformat.class is
deprecated. Instead, use mapreduce.job.outputformat.class
13/08/29 14:42:48 WARN conf.Configuration: mapred.map.tasks is deprecated.
Instead, use mapreduce.job.maps
13/08/29 14:42:48 WARN conf.Configuration: mapred.output.key.class is
deprecated. Instead, use mapreduce.job.output.key.class
13/08/29 14:42:48 WARN conf.Configuration: mapred.working.dir is
deprecated. Instead, use mapreduce.job.working.dir
13/08/29 14:42:49 INFO mapreduce.JobSubmitter: Submitting tokens for job:
13/08/29 14:42:50 INFO impl.YarnClientImpl: Submitted application
application_1377787324271_0001 to ResourceManager at master.local/
13/08/29 14:42:50 INFO mapreduce.Job: The url to track the job:
13/08/29 14:42:50 INFO mapreduce.Job: Running job: job_1377787324271_0001

and then it stops. If I check the UI, I see this:

vagrantTeraGenMAPREDUCEdefaultThu, 29 Aug 2013 14:42:49 GMTN/AACCEPTED

UNASSIGNED <http://master.local:8088/cluster/apps#>
I have no idea, why it is not starting, nor what to look for. Any pointers
are more than welcome!


- André

André Kelpe

View raw message