hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thejas M Nair (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-13151) Clean up UGI objects in FileSystem cache for transactions
Date Tue, 22 Mar 2016 06:05:25 GMT

    [ https://issues.apache.org/jira/browse/HIVE-13151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15205863#comment-15205863
] 

Thejas M Nair commented on HIVE-13151:
--------------------------------------

bq. Shouldn't this be solved in Hadoop? If anything else is using UGI the cache will still
leak.
AFAIK all of them end up calling closeAllForUgi to avoid the 'cache' leak.

I heard long ago about some new interfaces that would change this. Not sure if that was a
concrete proposal. cc [~sanjay.radia] [~jnp]


> Clean up UGI objects in FileSystem cache for transactions
> ---------------------------------------------------------
>
>                 Key: HIVE-13151
>                 URL: https://issues.apache.org/jira/browse/HIVE-13151
>             Project: Hive
>          Issue Type: Bug
>          Components: Hive
>    Affects Versions: 2.0.0
>            Reporter: Wei Zheng
>            Assignee: Wei Zheng
>         Attachments: HIVE-13151.1.patch, HIVE-13151.2.patch, HIVE-13151.3.patch
>
>
> One issue with FileSystem.CACHE is that it does not clean itself. The key in that cache
includes UGI object. When new UGI objects are created and used with the FileSystem api, new
entries get added to the cache.
> We need to manually clean up those UGI objects once they are no longer in use.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message