hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sergey Shelukhin (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-15665) LLAP: OrcFileMetadata objects in cache can impact heap usage
Date Thu, 14 Sep 2017 00:32:03 GMT

    [ https://issues.apache.org/jira/browse/HIVE-15665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16165529#comment-16165529
] 

Sergey Shelukhin commented on HIVE-15665:
-----------------------------------------

Test failures are unrelated. [~prasanth_j] can you take a look at the update?

> LLAP: OrcFileMetadata objects in cache can impact heap usage
> ------------------------------------------------------------
>
>                 Key: HIVE-15665
>                 URL: https://issues.apache.org/jira/browse/HIVE-15665
>             Project: Hive
>          Issue Type: Improvement
>          Components: llap
>            Reporter: Rajesh Balamohan
>            Assignee: Sergey Shelukhin
>         Attachments: HIVE-15665.01.patch, HIVE-15665.02.patch, HIVE-15665.03.patch, HIVE-15665.04.patch,
HIVE-15665.05.patch, HIVE-15665.06.patch, HIVE-15665.07.patch, HIVE-15665.08.patch, HIVE-15665.09.patch,
HIVE-15665.10.patch, HIVE-15665.11.patch, HIVE-15665.patch
>
>
> OrcFileMetadata internally has filestats, stripestats etc which are allocated in heap.
On large data sets, this could have an impact on the heap usage and the memory usage by different
executors in LLAP.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message