hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Robert Joseph Evans (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-3824) Distributed caches are not removed properly
Date Tue, 07 Feb 2012 19:17:00 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-3824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202647#comment-13202647

Robert Joseph Evans commented on MAPREDUCE-3824:

I agree with you the the 1.0 distributed cache code is a mess.  I don't really understand
all of what it is doing, especially with how it interacts with other parts of TT.  I agree
a rewrite would be good. And I think that is what YARN is for.  I would be happy to commit
your patch for you.  At a minimum the volatile change needs to go in, and the rest I just
want to feel comfortable that it will not cause more harm then good.  Also if you want to
place limits on the size of files placed in the distributed cache, please file a JIRA for
that, it would be a great addition.
> Distributed caches are not removed properly
> -------------------------------------------
>                 Key: MAPREDUCE-3824
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3824
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: distributed-cache
>    Affects Versions: 1.0.0
>            Reporter: Allen Wittenauer
>            Priority: Critical
>         Attachments: MAPREDUCE-3824-branch-1.0.txt
> Distributed caches are not being properly removed by the TaskTracker when they are expected
to be expired. 

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message