hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Edmund Kohlwey <ekohl...@gmail.com>
Subject Re: what does it mean when a job fails at 100%?
Date Fri, 13 Nov 2009 22:15:17 GMT
Lots of things can happen. If you have a cleanup method, that can fail 
after map and reduce complete. Also, hadoop writes the output of a task 
to local disk, and only commits the results of the individual tasks to 
HDFS after they complete, so you might be failing on the copy to HDFS.

On 11/13/09 5:02 PM, Mike Kendall wrote:
> title says it all..  this isn't the first job i've written either.  very
> confused.

View raw message