hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Dennis Kubes <nutch-...@dragonflymc.com>
Subject Re: [jira] Resolved: (HADOOP-262) the reduce tasks do not report progress if they the map output locations is empty.
Date Mon, 05 Jun 2006 20:18:57 GMT
Thanks for this.  I have been banging up against errors caused by the 
ReduceTasks failing because of waits for about a week now.  This fixes it.

Dennis

Doug Cutting (JIRA) wrote:
>      [ http://issues.apache.org/jira/browse/HADOOP-262?page=all ]
>      
> Doug Cutting resolved HADOOP-262:
> ---------------------------------
>
>     Fix Version: 0.3.1
>                      (was: 0.3.0)
>      Resolution: Fixed
>
> I just committed this.  Thanks, Mahadev.
>
>   
>> the reduce tasks do not report progress if they the map output locations is empty.
>> ----------------------------------------------------------------------------------
>>
>>          Key: HADOOP-262
>>          URL: http://issues.apache.org/jira/browse/HADOOP-262
>>      Project: Hadoop
>>         Type: Bug
>>     
>
>   
>>   Components: mapred
>>     Versions: 0.3.0
>>     Reporter: Mahadev konar
>>     Assignee: Mahadev konar
>>      Fix For: 0.3.1
>>  Attachments: reduce_sleep.patch
>>
>> The ReduceTaskRunner should report progress even if the number of ouput locations
to copy is empty. In case, the last few maps are running on a tasktracker that goes down,
all the reduce tasks waiting for these mapoutputs would fail.
>>     
>
>   

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message