hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alexander Pivovarov (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-4501) HS2 memory leak - FileSystem objects in FileSystem.CACHE
Date Wed, 25 Sep 2013 23:21:03 GMT

    [ https://issues.apache.org/jira/browse/HIVE-4501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13778217#comment-13778217
] 

Alexander Pivovarov commented on HIVE-4501:
-------------------------------------------

Probably we can set ctx.setHDFSCleanup(false) in Driver   (lines 415, 1126)
after that the fix reverted here should work https://github.com/apache/hive/commit/4de1b5acc0b0507787bc8e74259a15e414dcb49e

set HDFScleanup to false is ok because clean of tmp files on exit did not work because fs
was never closed.
                
> HS2 memory leak - FileSystem objects in FileSystem.CACHE
> --------------------------------------------------------
>
>                 Key: HIVE-4501
>                 URL: https://issues.apache.org/jira/browse/HIVE-4501
>             Project: Hive
>          Issue Type: Bug
>          Components: HiveServer2
>    Affects Versions: 0.11.0
>            Reporter: Thejas M Nair
>            Assignee: Thejas M Nair
>            Priority: Critical
>         Attachments: HIVE-4501.1.patch
>
>
> org.apache.hadoop.fs.FileSystem objects are getting accumulated in FileSystem.CACHE,
with HS2 in unsecure mode.
> As a workaround, it is possible to set fs.hdfs.impl.disable.cache and fs.file.impl.disable.cache
to true.
> Users should not have to bother with this extra configuration. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message