hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Devaraj Das (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-1042) Improve the handling of failed map output fetches
Date Tue, 27 Feb 2007 18:54:05 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-1042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Devaraj Das updated HADOOP-1042:
--------------------------------

    Attachment: 1042.new.patch

Ok, this patch incorporates David's comment (replaced only one line with what David suggested
since that was the only place where such a thing was done). Actually, there are lots of places
in the codebase where similar warnings can be removed.

> Improve the handling of failed map output fetches
> -------------------------------------------------
>
>                 Key: HADOOP-1042
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1042
>             Project: Hadoop
>          Issue Type: Improvement
>          Components: mapred
>    Affects Versions: 0.11.2
>            Reporter: Devaraj Das
>         Assigned To: Devaraj Das
>         Attachments: 1042.new.patch, 1042.patch
>
>
> Currently, whenever fetch of a map output fails the corresponding MapOutputLocation is
added to a List datastructure for later retrial. But, if the failure was due to a lost task,
the entry that was added is not deleted. For such cases, unnecessary retrials will happen.
This situation should be prevented.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message