hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daryn Sharp (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-9757) Har metadata cache can grow without limit
Date Mon, 05 Aug 2013 18:00:50 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-9757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13729727#comment-13729727

Daryn Sharp commented on HADOOP-9757:

+1 I'm not thrilled with the way har works, but I suppose this is the best we can for now
to fix the leak.
> Har metadata cache can grow without limit
> -----------------------------------------
>                 Key: HADOOP-9757
>                 URL: https://issues.apache.org/jira/browse/HADOOP-9757
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 2.0.4-alpha, 0.23.9
>            Reporter: Jason Lowe
>            Assignee: Cristina L. Abad
>         Attachments: HADOOP_9757.branch23.patch
> MAPREDUCE-2459 added a metadata cache to the har filesystem, but the cache has no upper
limits.  A long-running process that accesses many har archives will eventually run out of
memory due to a har metadata cache that never retires entries.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message