hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Bertrand Dechoux <decho...@gmail.com>
Subject Re: Collecting error messages from Mappers
Date Mon, 08 Oct 2012 14:32:58 GMT
If it is only to get a parse overview of the run you can use counters. But
you shouldn't overuse them.
You can for example count exceptions by type (but by message is not a good
approach unless you are sure that the message is constant.)

Regards

Bertrand

On Mon, Oct 8, 2012 at 4:13 PM, Terry Healy <thealy@bnl.gov> wrote:

> Hi-
>
> Is there a simple way for error output / debug information generated by
> a Mapper to be collected in one place for a given M/R job run? I guess
> what I'm hoping for is sort of the reverse of a Distributed Cache function.
>
> Can anyone suggest an approach?
>
> Thanks,
>
> Terry
>



-- 
Bertrand Dechoux

Mime
View raw message