hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Feng Yuan (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HIVE-13926) How to limit reduce memory only not Map and Reduce all in Tez engine
Date Thu, 02 Jun 2016 15:55:59 GMT
Feng Yuan created HIVE-13926:
--------------------------------

             Summary: How to limit reduce memory only not Map and Reduce all in Tez engine
                 Key: HIVE-13926
                 URL: https://issues.apache.org/jira/browse/HIVE-13926
             Project: Hive
          Issue Type: New Feature
          Components: Query Planning
    Affects Versions: 2.0.0
            Reporter: Feng Yuan
             Fix For: tez-branch


Now there is only a property:hive.tez.container.size.
This will modify map and reduce`s memory all.
If i want turn up reduce`s memory only.How could i do?
------------------------------------
And i think if there is a possiblilty for dynamiclly allocate reduce`s memory 
depend on reduce`s input size!
detils:
assume a reduce is allocated 2GB before.And in this condition a reduce`s normal input size
is 1GB ,and when reduce`s input is 2GB, if hive can turn up mem to 4GB auto?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message