hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hemanth Yamijala (JIRA)" <j...@apache.org>
Subject [jira] Commented: (MAPREDUCE-1140) Per cache-file refcount can become negative when tasks release distributed-cache files
Date Mon, 30 Nov 2009 04:39:21 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-1140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12783533#action_12783533

Hemanth Yamijala commented on MAPREDUCE-1140:

I looked at the Yahoo! hadoop 0.20 patch, and have the same comment with respect to throwing
the exception in DistributedCache.getLocalCache. Other than that, it looks fine.

Regarding the tests, I spoke offline to Amarsri to understand the scenario executed by Karthikeyan
in the comment above. It was not very clear why file1 was being added twice. Some more details
on configuration - that it was run on a single node, max failures was set to 1 should be documented
for better understanding.

In order to match the regressions tests in trunk, I would suggest we also have in Job 2 a
file, say file5, which we should verify is not even localized (because file3 fails localization).
Then we can include file 5 in Job 3 and make sure localization happens successfully.

> Per cache-file refcount can become negative when tasks release distributed-cache files
> --------------------------------------------------------------------------------------
>                 Key: MAPREDUCE-1140
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1140
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: tasktracker
>    Affects Versions: 0.20.2, 0.21.0, 0.22.0
>            Reporter: Vinod K V
>            Assignee: Amareshwari Sriramadasu
>         Attachments: patch-1140-1.txt, patch-1140-2.txt, patch-1140-3.txt, patch-1140-ydist.txt,
patch-1140-ydist.txt, patch-1140.txt

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message