hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yin Huai (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-5910) In HiveConf, the name of mapred.min.split.size.per.rack is MAPREDMINSPLITSIZEPERNODE and the name of mapred.min.split.size.per.node is MAPREDMINSPLITSIZEPERRACK
Date Sun, 01 Dec 2013 01:10:35 GMT

    [ https://issues.apache.org/jira/browse/HIVE-5910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13835921#comment-13835921
] 

Yin Huai commented on HIVE-5910:
--------------------------------

[~leftylev] Actually, these two are MapReduce configurations. Seems these two are internally
used in Hive. I am not sure if we need to add them to add them to our conf template.

> In HiveConf, the name of mapred.min.split.size.per.rack is MAPREDMINSPLITSIZEPERNODE
and the name of mapred.min.split.size.per.node is MAPREDMINSPLITSIZEPERRACK
> ----------------------------------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-5910
>                 URL: https://issues.apache.org/jira/browse/HIVE-5910
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Yin Huai
>
> In HiveConf.java ...
> {code}
> MAPREDMINSPLITSIZEPERNODE("mapred.min.split.size.per.rack", 1L),
> MAPREDMINSPLITSIZEPERRACK("mapred.min.split.size.per.node", 1L),
> {\code}
> Then, in ExecDriver.java ...
> {code}
> if (mWork.getMinSplitSizePerNode() != null) {
>       HiveConf.setLongVar(job, HiveConf.ConfVars.MAPREDMINSPLITSIZEPERNODE, mWork.getMinSplitSizePerNode().longValue());
>     }
>  if (mWork.getMinSplitSizePerRack() != null) {
>       HiveConf.setLongVar(job, HiveConf.ConfVars.MAPREDMINSPLITSIZEPERRACK, mWork.getMinSplitSizePerRack().longValue());
> }
> {\code}



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message