hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Joey Echeverria <j...@cloudera.com>
Subject Re: map task attempt progress at 400%?
Date Thu, 03 Nov 2011 13:44:21 GMT
Is you input data compressed? There have been some bugs in the past
with reporting progress when reading compressed data.

-Joey

On Thu, Nov 3, 2011 at 9:18 AM, Brendan W. <bw8408@gmail.com> wrote:
> Hi,
>
> Running 0.20.2:
>
> A job with about 4000 map tasks quickly blew through all but 3 in a couple
> of hours, with the tasks taking about two minutes each.  The remaining
> three, however, inched along, with their progress passing 100% and keeping
> on going.  After 20 hours or so, I killed the running task attempts.  They
> restarted, and same thing:  they inched their way past 100%, getting up
> past 400% and continuing.  They finally finished in the middle of last
> night.
>
> What does progress > 100% indicate?
>
> Thanks for any help.
>



-- 
Joseph Echeverria
Cloudera, Inc.
443.305.9434

Mime
View raw message