hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Amareshwari Sriramadasu (JIRA)" <j...@apache.org>
Subject [jira] Commented: (MAPREDUCE-1140) Per cache-file refcount can become negative when tasks release distributed-cache files
Date Thu, 05 Nov 2009 04:34:34 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-1140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12773771#action_12773771
] 

Amareshwari Sriramadasu commented on MAPREDUCE-1140:
----------------------------------------------------

bq. We need to maintain a map of attempts to the corresponding localized-files.
The list of localizedCacheFiles is maintained in TaskDistributedCacheManager, which is one
per attempt. 

bq. a URI has to be added to the map only after its localization is done i.e. after getLocalCache()
and not before like the way it is done in this patch.
This is done, because getLocalCache increments referenceCount first and then localizes. Reference
count should be decremented for the one just failed also. So, it should be added to the list
before the getLocalCache call.



> Per cache-file refcount can become negative when tasks release distributed-cache files
> --------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-1140
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1140
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: tasktracker
>    Affects Versions: 0.20.2, 0.21.0, 0.22.0
>            Reporter: Vinod K V
>            Assignee: Amareshwari Sriramadasu
>         Attachments: patch-1140.txt
>
>


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message