hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Frank Lanitz <frank.lan...@sql-ag.de>
Subject Re: How to debug why example not finishing (or even starting)
Date Thu, 29 Jan 2015 12:47:05 GMT
Hi,

Sorry for spamming the list. ;)

Am 29.01.2015 um 05:38 schrieb Akira AJISAKA:
> Job.setJarByClass is missing in the grep job.
> 
>   https://issues.apache.org/jira/browse/MAPREDUCE-6231
> 
> Did you run another example job (ex. PiEstimator)?
> Other example jobs are setting user classes by Job.setJarByClass.
> I'm thinking they would work in your environment.

Well, finally some of the other examples are working but seem to also
get stuck at some point.
E.g.

> $ hadoop jar /home/hadoop/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.6.0.jar
pi 16 100000
> Number of Maps  = 16
> Samples per Map = 100000
> 15/01/29 13:38:18 WARN util.NativeCodeLoader: Unable to load native-hadoop library for
your platform... using builtin-java classes where applicable
> Wrote input for Map #0
> Wrote input for Map #1
> Wrote input for Map #2
> Wrote input for Map #3
> Wrote input for Map #4
> Wrote input for Map #5
> Wrote input for Map #6
> Wrote input for Map #7
> Wrote input for Map #8
> Wrote input for Map #9
> Wrote input for Map #10
> Wrote input for Map #11
> Wrote input for Map #12
> Wrote input for Map #13
> Wrote input for Map #14
> Wrote input for Map #15
> Starting Job
> 15/01/29 13:38:19 INFO client.RMProxy: Connecting to ResourceManager at hadoopm/192.168.20.235:8032
> 15/01/29 13:38:19 INFO input.FileInputFormat: Total input paths to process : 16
> 15/01/29 13:38:19 INFO mapreduce.JobSubmitter: number of splits:16
> 15/01/29 13:38:20 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1422524123097_0008
> 15/01/29 13:38:20 INFO impl.YarnClientImpl: Submitted application application_1422524123097_0008
> 15/01/29 13:38:20 INFO mapreduce.Job: The url to track the job: http://hadoopm:8088/proxy/application_1422524123097_0008/
> 15/01/29 13:38:20 INFO mapreduce.Job: Running job: job_1422524123097_0008

and then noting more happens. When checking the job-list it's saying
that it is still in prep mode:

> $ mapred job -list
> 15/01/29 13:45:18 WARN util.NativeCodeLoader: Unable to load native-hadoop library for
your platform... using builtin-java classes where applicable
> 15/01/29 13:45:18 INFO client.RMProxy: Connecting to ResourceManager at hadoopm/192.168.20.235:8032
> Total jobs:1
>                   JobId      State           StartTime      UserName           Queue
     Priority       UsedContainers  RsvdContainers  UsedMem         RsvdMem         NeededMem
        AM info
>  job_1422524123097_0008       PREP       1422535100215        hadoop         default
       NORMAL                    1               0    2048M              0M             2048M
     http://hadoopm:8088/proxy/application_1422524123097_0008/

So my original question is still active: Where I have to dig in to see,
why it's not starting. What am I looking for?

Cheers,
Frank

Mime
View raw message