hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "John Zhuge (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-10297) Increase default balance bandwidth and concurrent moves
Date Tue, 26 Apr 2016 21:58:13 GMT

     [ https://issues.apache.org/jira/browse/HDFS-10297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

John Zhuge updated HDFS-10297:
------------------------------
    Attachment: HDFS-10297.003.branch-2.8.patch

Upload HDFS-10297.003.branch-2.8.patch for branch 2.8.

> Increase default balance bandwidth and concurrent moves
> -------------------------------------------------------
>
>                 Key: HDFS-10297
>                 URL: https://issues.apache.org/jira/browse/HDFS-10297
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: balancer & mover
>    Affects Versions: 2.6.0
>            Reporter: John Zhuge
>            Assignee: John Zhuge
>            Priority: Minor
>              Labels: supportability
>             Fix For: 2.9.0
>
>         Attachments: HDFS-10297.001.patch, HDFS-10297.002.patch, HDFS-10297.003.branch-2.8.patch,
HDFS-10297.003.patch
>
>
> Adjust the default values to better support the current level of customer host and network
configurations.
> Increase the default for property {{dfs.datanode.balance.bandwidthPerSec}} from 1 to
10 MB. Apply to DN. 10 MB/s is about 10% of the GbE network.
> Increase the default for property {{dfs.datanode.balance.max.concurrent.moves}} from
5 to 50. Apply to DN and Balancer. The default number of DN receiver threads is 4096. The
default number of balancer mover threads is 1000.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message