hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "David Kjerrumgaard (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-8255) Need additional properties to control size of mapper and reducer containers independently for tez tasks.
Date Thu, 25 Sep 2014 16:49:36 GMT

     [ https://issues.apache.org/jira/browse/HIVE-8255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

David Kjerrumgaard updated HIVE-8255:
-------------------------------------
    Description: 
There were 2 memory related configuration properties added in HIVE-6037, hive.tez.container.size
& hive.tez.java.opts. 

These settings apply to BOTH the mapper and reducer tasks in a TEZ job. Usually, the amount
of memory required for your map tasks varies greatly from the memory requirements for your
reducers. Therefore, it would be better if the hive.tez.container.size & hive.tez.java.opts
properties were replaced with map and reduce specific ones, e.g.

hive.tez.map.container.size & hive.tez.map.java.opts
hive.tez.reduce.container.size & hive.tez.reduce.java.opts


> Need additional properties to control size of mapper and reducer containers independently
for tez tasks.
> --------------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-8255
>                 URL: https://issues.apache.org/jira/browse/HIVE-8255
>             Project: Hive
>          Issue Type: Improvement
>          Components: Tez
>    Affects Versions: 0.13.1
>            Reporter: David Kjerrumgaard
>            Priority: Minor
>
> There were 2 memory related configuration properties added in HIVE-6037, hive.tez.container.size
& hive.tez.java.opts. 
> These settings apply to BOTH the mapper and reducer tasks in a TEZ job. Usually, the
amount of memory required for your map tasks varies greatly from the memory requirements for
your reducers. Therefore, it would be better if the hive.tez.container.size & hive.tez.java.opts
properties were replaced with map and reduce specific ones, e.g.
> hive.tez.map.container.size & hive.tez.map.java.opts
> hive.tez.reduce.container.size & hive.tez.reduce.java.opts



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message