hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Geoffry Roberts <geoffry.robe...@gmail.com>
Subject What does MAX_FAILED_UNIQUE_FETCHES mean?
Date Mon, 27 Jul 2009 16:12:33 GMT
All,

I am attempting to run my first map reduce job and I am getting the
following error.  Does anyone know what it means?

Shuffle Error: Exceeded MAX_FAILED_UNIQUE_FETCHES; bailing-out.


Full text of the output follows:

09/07/27 07:06:54 WARN mapred.JobClient: Use GenericOptionsParser for
parsing the arguments. Applications should implement Tool for the same.
09/07/27 07:06:55 INFO mapred.FileInputFormat: Total input paths to process
: 1
09/07/27 07:06:56 INFO mapred.JobClient: Running job: job_200907270706_0001
09/07/27 07:06:57 INFO mapred.JobClient:  map 0% reduce 0%
09/07/27 07:07:04 INFO mapred.JobClient:  map 50% reduce 0%
09/07/27 07:07:08 INFO mapred.JobClient:  map 100% reduce 0%
09/07/27 07:07:19 INFO mapred.JobClient: Task Id :
attempt_200907270706_0001_r_000000_0, Status : FAILED
Shuffle Error: Exceeded MAX_FAILED_UNIQUE_FETCHES; bailing-out.
09/07/27 07:07:19 WARN mapred.JobClient: Error reading task
outputhbase3.qn-niat.net
09/07/27 07:07:19 WARN mapred.JobClient: Error reading task
outputhbase3.qn-niat.net
09/07/27 07:07:29 INFO mapred.JobClient: Task Id :
attempt_200907270706_0001_r_000000_1, Status : FAILED
Shuffle Error: Exceeded MAX_FAILED_UNIQUE_FETCHES; bailing-out.
09/07/27 07:07:29 WARN mapred.JobClient: Error reading task
outputhbase3.qn-niat.net
09/07/27 07:07:29 WARN mapred.JobClient: Error reading task
outputhbase3.qn-niat.net
09/07/27 07:07:40 INFO mapred.JobClient: Task Id :
attempt_200907270706_0001_r_000000_2, Status : FAILED
Shuffle Error: Exceeded MAX_FAILED_UNIQUE_FETCHES; bailing-out.
09/07/27 07:07:40 WARN mapred.JobClient: Error reading task
outputhbase3.qn-niat.net
09/07/27 07:07:40 WARN mapred.JobClient: Error reading task
outputhbase3.qn-niat.net
java.io.IOException: Job failed!
        at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1232)
        at qq.mob.mr.first.FirstMapRed.main(FirstMapRed.java:102)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.hadoop.util.RunJar.main(RunJar.java:165)
        at org.apache.hadoop.mapred.JobShell.run(JobShell.java:54)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
        at org.apache.hadoop.mapred.JobShell.main(JobShell.java:68)

Mime
View raw message