hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Wang (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-10297) Increase default balance bandwidth and concurrent moves
Date Tue, 26 Apr 2016 20:08:12 GMT

     [ https://issues.apache.org/jira/browse/HDFS-10297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Andrew Wang updated HDFS-10297:
-------------------------------
    Fix Version/s: 2.9.0

Committed to trunk and branch-2, branch-2.8 wasn't clean. John, if you want it in 2.8, do
you mind providing a branch-2.8 patch? Else we can just resolve.

> Increase default balance bandwidth and concurrent moves
> -------------------------------------------------------
>
>                 Key: HDFS-10297
>                 URL: https://issues.apache.org/jira/browse/HDFS-10297
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: balancer & mover
>    Affects Versions: 2.6.0
>            Reporter: John Zhuge
>            Assignee: John Zhuge
>            Priority: Minor
>              Labels: supportability
>             Fix For: 2.9.0
>
>         Attachments: HDFS-10297.001.patch, HDFS-10297.002.patch, HDFS-10297.003.patch
>
>
> Adjust the default values to better support the current level of customer host and network
configurations.
> Increase the default for property {{dfs.datanode.balance.bandwidthPerSec}} from 1 to
10 MB. Apply to DN. 10 MB/s is about 10% of the GbE network.
> Increase the default for property {{dfs.datanode.balance.max.concurrent.moves}} from
5 to 50. Apply to DN and Balancer. The default number of DN receiver threads is 4096. The
default number of balancer mover threads is 1000.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message