hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Rajesh Jain <rjai...@gmail.com>
Subject Hadoop MapReduce Fails with FileNotFound Exception
Date Tue, 13 Aug 2013 23:57:51 GMT
We are seeing the sample PI Program 

hadoop jar /home/hadoop-setup/share/hadoop/mapreduce/hadoop-mapreduce-
examples-2.0.3-alpha.jar pi 10 10



13/08/13 13:11:20 INFO mapreduce.Job: Running job: job_1376424532537_0002
13/08/13 13:11:27 INFO mapreduce.Job: Job job_1376424532537_0002 running in 
uber mode : false
13/08/13 13:11:27 INFO mapreduce.Job:  map 0% reduce 0%
13/08/13 13:11:28 INFO mapreduce.Job: Task Id : 
attempt_1376424532537_0002_m_000007_0, Status : FAILED


13/08/13 13:11:29 INFO mapreduce.Job: Task Id : 
attempt_1376424532537_0002_m_000000_0, Status : FAILED


13/08/13 13:11:29 INFO mapreduce.Job: Task Id : 
attempt_1376424532537_0002_m_000001_0, Status : FAILED


13/08/13 13:11:29 INFO mapreduce.Job: Task Id : 
attempt_1376424532537_0002_m_000003_0, Status : FAILED


13/08/13 13:11:29 INFO mapreduce.Job: Task Id : 
attempt_1376424532537_0002_m_000008_0, Status : FAILED


13/08/13 13:11:29 INFO mapreduce.Job: Task Id : 
attempt_1376424532537_0002_m_000002_0, Status : FAILED


13/08/13 13:11:29 INFO mapreduce.Job: Task Id : 
attempt_1376424532537_0002_m_000009_0, Status : FAILED


13/08/13 13:11:34 INFO mapreduce.Job: Task Id : 
attempt_1376424532537_0002_m_000008_2, Status : FAILED


13/08/13 13:11:35 INFO mapreduce.Job: Task Id : 
attempt_1376424532537_0002_m_000009_2, Status : FAILED


13/08/13 13:11:35 INFO mapreduce.Job: Task Id : 
attempt_1376424532537_0002_m_000003_2, Status : FAILED


13/08/13 13:11:35 INFO mapreduce.Job: Task Id : 
attempt_1376424532537_0002_m_000005_2, Status : FAILED


13/08/13 13:11:35 INFO mapreduce.Job: Task Id : 
attempt_1376424532537_0002_m_000002_2, Status : FAILED


13/08/13 13:11:35 INFO mapreduce.Job: Task Id : 
attempt_1376424532537_0002_m_000006_2, Status : FAILED


13/08/13 13:11:36 INFO mapreduce.Job: Task Id : 
attempt_1376424532537_0002_m_000004_2, Status : FAILED


13/08/13 13:11:36 INFO mapreduce.Job:  map 40% reduce 0%
13/08/13 13:11:36 INFO mapreduce.Job: Job job_1376424532537_0002 failed with 
state FAILED due to: Task failed task_1376424532537_0002_m_000008
Job failed as tasks failed. failedMaps:1 failedReduces:0

13/08/13 13:11:36 INFO mapreduce.Job: Counters: 10
        Job Counters 
                Failed map tasks=33
                Launched map tasks=38
                Other local map tasks=29
                Data-local map tasks=6
                Rack-local map tasks=4
                Total time spent by all maps in occupied slots (ms)=41867
                Total time spent by all reduces in occupied slots (ms)=0
        Map-Reduce Framework
                CPU time spent (ms)=0
                Physical memory (bytes) snapshot=0
                Virtual memory (bytes) snapshot=0
Job Finished in 16.998 seconds
java.io.FileNotFoundException: File does not exist: 
hdfs://server:9000/user/hadoop-
rb/QuasiMonteCarlo_1376424678245_1232352127/out/reduce-out
        at 
org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSy
stem.java:815)
        at org.apache.hadoop.io.SequenceFile$Reader.<init>
(SequenceFile.java:1749)
        at org.apache.hadoop.io.SequenceFile$Reader.<init>
(SequenceFile.java:1773)
        at 
org.apache.hadoop.examples.QuasiMonteCarlo.estimatePi(QuasiMonteCarlo.java:3
14)
        at 
org.apache.hadoop.examples.QuasiMonteCarlo.run(QuasiMonteCarlo.java:354)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
        at 
org.apache.hadoop.examples.QuasiMonteCarlo.main(QuasiMonteCarlo.java:363)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57
)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl
.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at 
org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver
.java:72)
        at 
org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:144)
        at 
org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:68)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57
)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl
.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at org.apache.hadoop.util.RunJar.main(RunJar.java:212)



Mime
View raw message