hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Amar Kamat <ama...@yahoo-inc.com>
Subject Re: reduce task progress above 100%?
Date Wed, 17 Sep 2008 05:26:49 GMT
Prasad Pingali wrote:
> I am using 0.18.1-dev, upgraded from 0.18.0. I am also using compression for 
> map outputs.
>   
I think this is fixed in 19. Look here 
https://issues.apache.org/jira/browse/HADOOP-3131. We see this with 
compression turned ON.
Amar
> - Prasad.
>
> On Wednesday 17 September 2008 01:26:28 am Arun C Murthy wrote:
>   
>> On Sep 16, 2008, at 12:26 PM, pvvpr wrote:
>>     
>>> Hello,
>>>  A strange thing happened in my job. In reduce phase, one of the tasks
>>> status shows 101.44% complete and runs till some 102% and successfully
>>> finished back to 100%. Is this a right behavior?
>>>       
>> Which version of Hadoop are you running; and are you using compression
>> for map-outputs?
>>
>> Arun
>>
>>     
>>>  I put a quick copy-paste of the web GUI reporting completion of the
>>> tasks. (sorry for the bad formatting below).
>>>
>>> thanks,
>>> Prasad Pingali,
>>> IIIT Hyderabad.
>>>
>>>
>>>
>>> Task	Complete	Status	Start Time	Finish Time	Errors	Counters
>>> task_200809151235_0026_r_000000	90.91%
>>>
>>> 	reduce > reduce
>>> 	15-Sep-2008 18:40:06
>>>
>>>
>>>
>>>
>>> 	0
>>> task_200809151235_0026_r_000004	86.13%
>>>
>>> 	reduce > reduce
>>> 	15-Sep-2008 18:40:11
>>>
>>>
>>>
>>>
>>> 	0
>>> task_200809151235_0026_r_000008	85.08%
>>>
>>> 	reduce > reduce
>>> 	15-Sep-2008 18:40:16
>>>
>>>
>>>
>>>
>>> 	0
>>> task_200809151235_0026_r_000012	82.57%
>>>
>>> 	reduce > reduce
>>> 	15-Sep-2008 18:40:21
>>>
>>>
>>>
>>>
>>> 	0
>>> task_200809151235_0026_r_000014	97.90%
>>>
>>> 	reduce > reduce
>>> 	15-Sep-2008 18:40:22
>>>
>>>
>>>
>>>
>>> 	0
>>> task_200809151235_0026_r_000017	101.44%
>>> 	reduce > reduce
>>> 	15-Sep-2008 23:34:04
>>>
>>>
>>>
>>>
>>> 	0
>>>       
>
>
>
>
>   


Mime
View raw message