hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Smarty Juice <smarty.ju...@gmail.com>
Subject Can't run PI example on hadoop 0.23.1
Date Mon, 10 Sep 2012 22:19:53 GMT
Hello Champions,

I am a newbie to hadoop and trying to run first hadoop example : PI , but I
get the FIleNotFoundException, I do not know why its looking for this file
on hdfs, anyone pls help

Thank you,

>bin/hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-0.23.1.jar
pi -Dmapreduce.clientfactory.class.name=org.apache.hadoop.mapred.YarnClientFactory
-libjars
share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-0.23.1.jar 16 10000
12/09/06 19:56:10 WARN conf.Configuration: mapred.used.genericoptionsparser
is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
Number of Maps = 16
Samples per Map = 10000
Wrote input for Map #0
Wrote input for Map #1
Wrote input for Map #2
Wrote input for Map #3
Wrote input for Map #4
Wrote input for Map #5
Wrote input for Map #6
Wrote input for Map #7
Wrote input for Map #8
Wrote input for Map #9
Wrote input for Map #10
Wrote input for Map #11
Wrote input for Map #12
Wrote input for Map #13
Wrote input for Map #14
Wrote input for Map #15
Starting Job
12/09/06 19:56:22 WARN conf.Configuration: fs.default.name is deprecated.
Instead, use fs.defaultFS
12/09/06 19:56:22 INFO input.FileInputFormat: Total input paths to process
: 16
12/09/06 19:56:23 INFO mapreduce.JobSubmitter: number of splits:16
12/09/06 19:56:25 INFO mapred.ResourceMgrDelegate: Submitted application
application_1346972652940_0002 to ResourceManager at /0.0.0.0:8040
12/09/06 19:56:27 INFO mapreduce.Job: The url to track the job:
http://1.1.1.11:8088/proxy/application_1346972652940_0002/<http://10.215.12.11:8088/proxy/application_1346972652940_0002/>
12/09/06 19:56:27 INFO mapreduce.Job: Running job: job_1346972652940_0002
12/09/06 19:56:55 INFO mapreduce.Job: Job job_1346972652940_0002 running in
uber mode : false
12/09/06 19:56:55 INFO mapreduce.Job: map 0% reduce 0%
12/09/06 19:56:56 INFO mapreduce.Job: Job job_1346972652940_0002 failed
with state FAILED due to: Application application_1346972652940_0002 failed
1 times due to AM Container for appattempt_1346972652940_0002_000001 exited
with exitCode: 1 due to:
.Failing this attempt.. Failing the application.
12/09/06 19:56:56 INFO mapreduce.Job: Counters: 0
Job Finished in 35.048 seconds
java.io.FileNotFoundException: File does not exist:
hdfs://localhost:9000/user/XXXXX/QuasiMonteCarlo_TMP_3_141592654/out/reduce-out
at
org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:729)
at org.apache.hadoop.io.SequenceFile$Reader.(SequenceFile.java:1685)
at org.apache.hadoop.io.SequenceFile$Reader.(SequenceFile.java:1709)
at
org.apache.hadoop.examples.QuasiMonteCarlo.estimatePi(QuasiMonteCarlo.java:314)
at org.apache.hadoop.examples.QuasiMonteCarlo.run(QuasiMonteCarlo.java:351)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
at org.apache.hadoop.examples.QuasiMonteCarlo.main(QuasiMonteCarlo.java:360)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:72)
at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:144)
at org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:68)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:200)

Mime
View raw message