hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Arun C Murthy <...@yahoo-inc.com>
Subject Re: reduce task progress above 100%?
Date Tue, 16 Sep 2008 19:56:28 GMT

On Sep 16, 2008, at 12:26 PM, pvvpr wrote:

> Hello,
>  A strange thing happened in my job. In reduce phase, one of the tasks
> status shows 101.44% complete and runs till some 102% and successfully
> finished back to 100%. Is this a right behavior?
>

Which version of Hadoop are you running; and are you using compression  
for map-outputs?

Arun

>  I put a quick copy-paste of the web GUI reporting completion of the
> tasks. (sorry for the bad formatting below).
>
> thanks,
> Prasad Pingali,
> IIIT Hyderabad.
>
>
>
> Task	Complete	Status	Start Time	Finish Time	Errors	Counters
> task_200809151235_0026_r_000000	90.91%
>
> 	reduce > reduce
> 	15-Sep-2008 18:40:06
>
>
>
>
> 	0
> task_200809151235_0026_r_000004	86.13%
>
> 	reduce > reduce
> 	15-Sep-2008 18:40:11
>
>
>
>
> 	0
> task_200809151235_0026_r_000008	85.08%
>
> 	reduce > reduce
> 	15-Sep-2008 18:40:16
>
>
>
>
> 	0
> task_200809151235_0026_r_000012	82.57%
>
> 	reduce > reduce
> 	15-Sep-2008 18:40:21
>
>
>
>
> 	0
> task_200809151235_0026_r_000014	97.90%
>
> 	reduce > reduce
> 	15-Sep-2008 18:40:22
>
>
>
>
> 	0
> task_200809151235_0026_r_000017	101.44%
> 	reduce > reduce
> 	15-Sep-2008 23:34:04
>
>
>
>
> 	0
>
>


Mime
View raw message