hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ming Yang" <minghs...@gmail.com>
Subject Re: Map task failure recovery
Date Fri, 19 Oct 2007 13:57:48 GMT
Does it happen when running Hadoop locally as a single process?
I was testing my code locally and didn't see failure recovery.
The other thing is, how is "failure" defined? If in map(...) there's
a uncaught exception occurs and the task fails, can this kind of
failure be recovered?



2007/10/18, Owen O'Malley <oom@yahoo-inc.com>:
> On Oct 18, 2007, at 8:05 PM, Ming Yang wrote:
> > In the original MapReduce paper from Google, it mentioned
> > that healthy workers can take over failed task from other
> > workers. Does Hadoop has the same failure recovery strategy?
> Yes. If a task fails on one node, it is assigned to another free node
> automatically.

View raw message