hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lin Yiqun (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-9375) Set balancer bandwidth for specific node
Date Wed, 04 Nov 2015 15:22:27 GMT

     [ https://issues.apache.org/jira/browse/HDFS-9375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Lin Yiqun updated HDFS-9375:
----------------------------
    Attachment: HDFS-9375.001.patch

I attach the patch, add a new dfsadmin command {{setBalancerBandwidthForSpecificNode}},this
is a usage help {{[-setBalancerBandwidthForSpecificNode <datanode_host> <bandwidth>}}

> Set balancer bandwidth for specific node
> ----------------------------------------
>
>                 Key: HDFS-9375
>                 URL: https://issues.apache.org/jira/browse/HDFS-9375
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: balancer & mover
>    Affects Versions: 2.7.1
>            Reporter: Lin Yiqun
>            Assignee: Lin Yiqun
>         Attachments: HDFS-9375.001.patch
>
>
> Now even though the balancer is impove a lot, but In some cases that is still slow. For
example when the cluster is extended,the new nodes all need balancer datas from existed nodes.In
order to improve the balancer velocity,generally,we will use {{setBalancerBandwidth}} of {{dfsadmin}}
command.But this is set for every node, obviously,we can increase more bandwidth for new nodes
because these nodes lacking of data.When the new nodes balancer data enough,we can let new
nodes to work.So we can define a new clientDatanode interface to set specific node's bandwidth.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message