hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sergey Shelukhin (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-15665) LLAP: OrcFileMetadata objects in cache can impact heap usage
Date Fri, 21 Apr 2017 21:14:04 GMT

     [ https://issues.apache.org/jira/browse/HIVE-15665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Sergey Shelukhin updated HIVE-15665:
------------------------------------
    Attachment: HIVE-15665.wo.16233.patch
                HIVE-15665.patch

Rebased the patch on top of HIVE-16233. Also including the path with both for a test run,
this is still broken iirc

> LLAP: OrcFileMetadata objects in cache can impact heap usage
> ------------------------------------------------------------
>
>                 Key: HIVE-15665
>                 URL: https://issues.apache.org/jira/browse/HIVE-15665
>             Project: Hive
>          Issue Type: Improvement
>          Components: llap
>            Reporter: Rajesh Balamohan
>            Assignee: Sergey Shelukhin
>         Attachments: HIVE-15665.04.patch, HIVE-15665.patch, HIVE-15665.wo.16233.patch
>
>
> OrcFileMetadata internally has filestats, stripestats etc which are allocated in heap.
On large data sets, this could have an impact on the heap usage and the memory usage by different
executors in LLAP.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message