hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ning Zhang (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HIVE-1959) Potential memory leak when same connection used for long time. TaskInfo and QueryInfo objects are getting accumulated on executing more queries on the same connection.
Date Tue, 01 Mar 2011 20:08:36 GMT

    [ https://issues.apache.org/jira/browse/HIVE-1959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13001085#comment-13001085
] 

Ning Zhang commented on HIVE-1959:
----------------------------------

+1 on WeakHashMap. HiveHistory.endQuery() is called at the finally clause of Driver.execute().
There are some early exits (should be changed in my opinion. I will file another JIRA to fix
this) in the loop of execute() which will bypass the finally clause. Using WeakHashMap can
prevent leaks in this case.  

> Potential memory leak when same connection used for long time. TaskInfo and QueryInfo
objects are getting accumulated on executing more queries on the same connection.
> -----------------------------------------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-1959
>                 URL: https://issues.apache.org/jira/browse/HIVE-1959
>             Project: Hive
>          Issue Type: Bug
>          Components: Server Infrastructure
>    Affects Versions: 0.8.0
>         Environment: Hadoop 0.20.1, Hive0.5.0 and SUSE Linux Enterprise Server 10 SP2
(i586) - Kernel 2.6.16.60-0.21-smp (5).
>            Reporter: Chinna Rao Lalam
>            Assignee: Chinna Rao Lalam
>         Attachments: HIVE-1959.patch
>
>
> *org.apache.hadoop.hive.ql.history.HiveHistory$TaskInfo* and *org.apache.hadoop.hive.ql.history.HiveHistory$QueryInfo*
these two objects are getting accumulated on executing more number of queries on the same
connection. These objects are getting released only when the connection is closed.

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message