hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Prasanth Jayachandran (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-15503) LLAP: Fix use of Runtime.getRuntime.maxMemory in Hive operators
Date Fri, 23 Dec 2016 09:11:58 GMT

    [ https://issues.apache.org/jira/browse/HIVE-15503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15772377#comment-15772377
] 

Prasanth Jayachandran commented on HIVE-15503:
----------------------------------------------

RB link: https://reviews.apache.org/r/55010/

[~hagleitn] can you please review the patch?

> LLAP: Fix use of Runtime.getRuntime.maxMemory in Hive operators
> ---------------------------------------------------------------
>
>                 Key: HIVE-15503
>                 URL: https://issues.apache.org/jira/browse/HIVE-15503
>             Project: Hive
>          Issue Type: Bug
>    Affects Versions: 2.2.0
>            Reporter: Prasanth Jayachandran
>            Assignee: Prasanth Jayachandran
>            Priority: Critical
>         Attachments: HIVE-15503.1.patch, HIVE-15503.2.patch, HIVE-15503.WIP.patch
>
>
> {code}
> ql/src/java/org/apache/hadoop/hive/ql/exec/GroupByOperator.java:    maxHashTblMemory
= (long) (memoryPercentage * Runtime.getRuntime().maxMemory());
> ql/src/java/org/apache/hadoop/hive/ql/exec/TopNHash.java:    // Total Free Memory = maxMemory()
- Used Memory;
> ql/src/java/org/apache/hadoop/hive/ql/exec/TopNHash.java:    long totalFreeMemory = Runtime.getRuntime().maxMemory()
-
> {code}
> This will not work very well with LLAP because of the memory sharing by executors. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message