hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xuefu Zhang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-10006) RSC has memory leak while execute multi queries.[Spark Branch]
Date Fri, 20 Mar 2015 08:59:38 GMT

    [ https://issues.apache.org/jira/browse/HIVE-10006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14371009#comment-14371009
] 

Xuefu Zhang commented on HIVE-10006:
------------------------------------

Re: Besides, is this ThreadLocal MapWork/ReduceWork cache new introduced optimization?

Yes, it's introduced in HIVE-9127. Looks like we need to be careful about this threadlocal
map, indeed.

> RSC has memory leak while execute multi queries.[Spark Branch]
> --------------------------------------------------------------
>
>                 Key: HIVE-10006
>                 URL: https://issues.apache.org/jira/browse/HIVE-10006
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Spark
>    Affects Versions: 1.1.0
>            Reporter: Chengxiang Li
>            Assignee: Chengxiang Li
>            Priority: Critical
>              Labels: Spark-M5
>         Attachments: HIVE-10006.1-spark.patch, HIVE-10006.2-spark.patch, HIVE-10006.2-spark.patch,
HIVE-10006.3-spark.patch, HIVE-10006.4-spark.patch, HIVE-10006.5-spark.patch, HIVE-10006.6-spark.patch,
HIVE-10006.7-spark.patch
>
>
> While execute query with RSC, MapWork/ReduceWork number is increased all the time, and
lead to OOM at the end.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message