hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Natarajan, Senthil" <sent...@pitt.edu>
Subject Reduce Hangs
Date Thu, 27 Mar 2008 14:10:42 GMT
Hi,
I have small Hadoop cluster, one master and three slaves.
When I try the example wordcount on one of our log file (size ~350 MB)

Map runs fine but reduce always hangs (sometime around 19%,60% ...) after very long time it
finishes.
I am seeing this error
Shuffle Error: Exceeded MAX_FAILED_UNIQUE_FETCHES; bailing-out
In the log I am seeing this
INFO org.apache.hadoop.mapred.TaskTracker: task_200803261535_0001_r_000000_0 0.18333334% reduce
> copy (11 of 20 at 0.02 MB/s) >

Do you know what might be the problem.
Thanks,
Senthil


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message