hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Devaraj Das (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-1042) Improve the handling of failed map output fetches
Date Tue, 27 Feb 2007 18:54:05 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-1042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Devaraj Das updated HADOOP-1042:

    Attachment: 1042.new.patch

Ok, this patch incorporates David's comment (replaced only one line with what David suggested
since that was the only place where such a thing was done). Actually, there are lots of places
in the codebase where similar warnings can be removed.

> Improve the handling of failed map output fetches
> -------------------------------------------------
>                 Key: HADOOP-1042
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1042
>             Project: Hadoop
>          Issue Type: Improvement
>          Components: mapred
>    Affects Versions: 0.11.2
>            Reporter: Devaraj Das
>         Assigned To: Devaraj Das
>         Attachments: 1042.new.patch, 1042.patch
> Currently, whenever fetch of a map output fails the corresponding MapOutputLocation is
added to a List datastructure for later retrial. But, if the failure was due to a lost task,
the entry that was added is not deleted. For such cases, unnecessary retrials will happen.
This situation should be prevented.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message