hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Naveen Gangam (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-13749) Memory leak in Hive Metastore
Date Fri, 27 May 2016 15:47:12 GMT

    [ https://issues.apache.org/jira/browse/HIVE-13749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15304219#comment-15304219
] 

Naveen Gangam commented on HIVE-13749:
--------------------------------------

The retained size for each Configuration instance is roughly 100KB. ~66k instances x ~100KB
~= 6+GB. Thats what we are trying to address.

[~thejas] We have seen several issues around HMS stability (sudden death crashes) in the past,
a good % of them were OOMs, some connections leaks, some incorrectly sized thread pools etc.
We have asked customers to increase the max memory for the HMS process. Some customers running
with 40GB memory for HMS and that too at times is not enough. 16GB to 24GB is quite common
amongst other customers too. 
In the past, we have not received heap dumps from the process prior to the crash. So we did
not get a chance to analyze it.

> Memory leak in Hive Metastore
> -----------------------------
>
>                 Key: HIVE-13749
>                 URL: https://issues.apache.org/jira/browse/HIVE-13749
>             Project: Hive
>          Issue Type: Bug
>          Components: Metastore
>    Affects Versions: 1.1.0
>            Reporter: Naveen Gangam
>            Assignee: Naveen Gangam
>         Attachments: HIVE-13749.patch, Top_Consumers7.html
>
>
> Looking a heap dump of 10GB, a large number of Configuration objects(> 66k instances)
are being retained. These objects along with its retained set is occupying about 95% of the
heap space. This leads to HMS crashes every few days.
> I will attach an exported snapshot from the eclipse MAT.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message