hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "David Bowen (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-1042) Improve the handling of failed map output fetches
Date Tue, 27 Feb 2007 17:45:05 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-1042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12476242

David Bowen commented on HADOOP-1042:

A small point: in lines like this:

    Map<Integer, MapOutputLocation> knownOutputs = new HashMap(); 

it would be preferable (avoid a warning) to specify the types on the right hand side, like

  Map<Integer,MapOutputLocation> knownOutputs = new HashMap<Integer,MapOutputLocation>();

> Improve the handling of failed map output fetches
> -------------------------------------------------
>                 Key: HADOOP-1042
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1042
>             Project: Hadoop
>          Issue Type: Improvement
>          Components: mapred
>    Affects Versions: 0.11.2
>            Reporter: Devaraj Das
>         Assigned To: Devaraj Das
>         Attachments: 1042.patch
> Currently, whenever fetch of a map output fails the corresponding MapOutputLocation is
added to a List datastructure for later retrial. But, if the failure was due to a lost task,
the entry that was added is not deleted. For such cases, unnecessary retrials will happen.
This situation should be prevented.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message