hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vinod K V (JIRA)" <j...@apache.org>
Subject [jira] Commented: (MAPREDUCE-1140) Per cache-file refcount can become negative when tasks release distributed-cache files
Date Thu, 05 Nov 2009 04:10:32 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-1140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12773767#action_12773767
] 

Vinod K V commented on MAPREDUCE-1140:
--------------------------------------

I don't think this patch will work. If two different attempts use the same set of URIs with
the first succeeding in localizing all files wheres the second fails on some URI, the second
attempt will decrement refcounts for URIs that it itself has not localized!

We need to maintain a map of attempts to the corresponding 
localized-files.

Also, a URI has to be added to the map only after its localization is done i.e. after getLocalCache()
and not before like the way it is done in this patch.

> Per cache-file refcount can become negative when tasks release distributed-cache files
> --------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-1140
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1140
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: tasktracker
>    Affects Versions: 0.20.2, 0.21.0, 0.22.0
>            Reporter: Vinod K V
>            Assignee: Amareshwari Sriramadasu
>         Attachments: patch-1140.txt
>
>


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message