hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Larry McCay (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-10357) Memory Leak in UserGroupInformation.doAs for JDBC Connection to Hive
Date Wed, 05 Mar 2014 15:01:49 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-10357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13920927#comment-13920927
] 

Larry McCay commented on HADOOP-10357:
--------------------------------------

It was aborted early actually.
The 1004 is the number of connections that were made at the time it was
killed.

Also, the ensureInitialized method isn't going to work for the static
metrics registry.
I believe initialize is being called for each hive connection UGI instance.

The sample code does indeed call setConfiguration in the main().

Maybe setConfiguration is also being called by the hive driver?
That would be the only explanation for the static conf check not working in
ensureInitialized.
I haven't checked that.





> Memory Leak in UserGroupInformation.doAs for JDBC Connection to Hive
> --------------------------------------------------------------------
>
>                 Key: HADOOP-10357
>                 URL: https://issues.apache.org/jira/browse/HADOOP-10357
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: security
>    Affects Versions: 1.2.0
>            Reporter: Larry McCay
>         Attachments: visualvm-hive.png
>
>
> When using UGI.doAs in order to make a connection there appears to be a memory leak involving
the UGI that is used for the doAs and the UGI held by TUGIAssumingTransport.
> When using this approach to establishing a JDBC connection in an environment that will
serve many users and requests client side eventually runs out of memory.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message