hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Akira AJISAKA (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (MAPREDUCE-5906) Inconsistent configuration in property "mapreduce.reduce.shuffle.input.buffer.percent"
Date Tue, 27 May 2014 08:51:02 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-5906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Akira AJISAKA updated MAPREDUCE-5906:
-------------------------------------

    Affects Version/s: 2.4.0
               Labels: newbie  (was: )

> Inconsistent configuration in property "mapreduce.reduce.shuffle.input.buffer.percent"
> --------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-5906
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5906
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>    Affects Versions: 2.4.0
>            Reporter: Akira AJISAKA
>            Assignee: Akira AJISAKA
>            Priority: Minor
>              Labels: newbie
>
> In MergeManagerImpl.java, the default value of MRJobConfig.SHUFFLE_INPUT_BUFFER_PERCENT
(=mapreduce.reduce.shuffle.input.buffer.percent) looks 0.90.
> {code}
>   final float maxInMemCopyUse =
>     jobConf.getFloat(MRJobConfig.SHUFFLE_INPUT_BUFFER_PERCENT, 0.90f);
> {code}
> However, the actual default value is 0.70 in mapred-default.xml.
> {code}
>   <name>mapreduce.reduce.shuffle.input.buffer.percent</name>
>   <value>0.70</value>
> {code}



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message