hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Nemon Lou (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-11768) java.io.DeleteOnExitHook leaks memory on long running Hive Server2 Instances
Date Mon, 28 Sep 2015 02:02:04 GMT

    [ https://issues.apache.org/jira/browse/HIVE-11768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14909973#comment-14909973
] 

Nemon Lou commented on HIVE-11768:
----------------------------------

What HIVE-6091 did was trying to make sure the deletion of pipeout file before session close.
As the method deleteOnExit() is still there.
https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java#L828
I will reopen this issue.
This one will deal with the memory leak issue of File.deleteOnExit().


> java.io.DeleteOnExitHook leaks memory on long running Hive Server2 Instances
> ----------------------------------------------------------------------------
>
>                 Key: HIVE-11768
>                 URL: https://issues.apache.org/jira/browse/HIVE-11768
>             Project: Hive
>          Issue Type: Bug
>          Components: HiveServer2
>    Affects Versions: 1.2.1
>            Reporter: Nemon Lou
>            Assignee: Navis
>             Fix For: 2.0.0
>
>         Attachments: HIVE-11768.1.patch.txt, HIVE-11768.2.patch.txt
>
>
>   More than 490,000 paths was added to java.io.DeleteOnExitHook on one of our long running
HiveServer2 instances,taken up more than 100MB on heap.
>   Most of the paths contains a suffix of ".pipeout".



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message