hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daryn Sharp (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-9757) Har metadata cache can grow without limit
Date Mon, 05 Aug 2013 18:00:50 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-9757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13729727#comment-13729727
] 

Daryn Sharp commented on HADOOP-9757:
-------------------------------------

+1 I'm not thrilled with the way har works, but I suppose this is the best we can for now
to fix the leak.
                
> Har metadata cache can grow without limit
> -----------------------------------------
>
>                 Key: HADOOP-9757
>                 URL: https://issues.apache.org/jira/browse/HADOOP-9757
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 2.0.4-alpha, 0.23.9
>            Reporter: Jason Lowe
>            Assignee: Cristina L. Abad
>         Attachments: HADOOP_9757.branch23.patch
>
>
> MAPREDUCE-2459 added a metadata cache to the har filesystem, but the cache has no upper
limits.  A long-running process that accesses many har archives will eventually run out of
memory due to a har metadata cache that never retires entries.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message