hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Íñigo Goiri (JIRA) <j...@apache.org>
Subject [jira] [Commented] (HDFS-12802) RBF: Control MountTableResolver cache size
Date Sat, 11 Nov 2017 19:39:01 GMT

    [ https://issues.apache.org/jira/browse/HDFS-12802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16248634#comment-16248634
] 

Íñigo Goiri commented on HDFS-12802:
------------------------------------

We have been running a few Routers without stopping for a couple months and the memory footprint
was growing constantly.
We added a cache cleaner that periodically removed the unused resolutions.


> RBF: Control MountTableResolver cache size
> ------------------------------------------
>
>                 Key: HDFS-12802
>                 URL: https://issues.apache.org/jira/browse/HDFS-12802
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Íñigo Goiri
>            Assignee: Íñigo Goiri
>
> Currently, the {{MountTableResolver}} caches the resolutions for the {{PathLocation}}.
However, this cache can grow with no limits if there are a lot of unique paths. Some of these
cached resolutions might not be used at all.
> The {{MountTableResolver}} should clean the {{locationCache}} periodically.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message