hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thejas M Nair (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-4501) HS2 memory leak - FileSystem objects in FileSystem.CACHE
Date Fri, 14 Mar 2014 18:18:48 GMT

    [ https://issues.apache.org/jira/browse/HIVE-4501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13935377#comment-13935377
] 

Thejas M Nair commented on HIVE-4501:
-------------------------------------

The changes in HIVE-6312 (in 0.13) should fix this issue, as the unsecure mode now follows
same code path as secure mode, which calls closeAllForUGI .
I haven't verified with large number of requests and cache enabled, but if there is still
any leak its going to have a different root cause.


> HS2 memory leak - FileSystem objects in FileSystem.CACHE
> --------------------------------------------------------
>
>                 Key: HIVE-4501
>                 URL: https://issues.apache.org/jira/browse/HIVE-4501
>             Project: Hive
>          Issue Type: Bug
>          Components: HiveServer2
>    Affects Versions: 0.11.0
>            Reporter: Thejas M Nair
>            Assignee: Vaibhav Gumashta
>             Fix For: 0.13.0
>
>         Attachments: HIVE-4501.1.patch, HIVE-4501.1.patch, HIVE-4501.1.patch, HIVE-4501.trunk.patch
>
>
> org.apache.hadoop.fs.FileSystem objects are getting accumulated in FileSystem.CACHE,
with HS2 in unsecure mode.
> As a workaround, it is possible to set fs.hdfs.impl.disable.cache and fs.file.impl.disable.cache
to true.
> Users should not have to bother with this extra configuration. 
> As a workaround disable impersonation by setting hive.server2.enable.doAs to false.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message