hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lin Yiqun (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-9375) Set balancer bandwidth for specific node
Date Tue, 17 Nov 2015 00:15:11 GMT

     [ https://issues.apache.org/jira/browse/HDFS-9375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Lin Yiqun updated HDFS-9375:
    Attachment: HDFS-9375.004.patch

> Set balancer bandwidth for specific node
> ----------------------------------------
>                 Key: HDFS-9375
>                 URL: https://issues.apache.org/jira/browse/HDFS-9375
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: balancer & mover
>    Affects Versions: 2.7.1
>            Reporter: Lin Yiqun
>            Assignee: Lin Yiqun
>         Attachments: HDFS-9375.001.patch, HDFS-9375.002.patch, HDFS-9375.003.patch, HDFS-9375.004.patch
> Now even though the balancer is impove a lot, but In some cases that is still slow. For
example when the cluster is extended,the new nodes all need balancer datas from existed nodes.In
order to improve the balancer velocity,generally,we will use {{setBalancerBandwidth}} of {{dfsadmin}}
command.But this is set for every node, obviously,we can increase more bandwidth for new nodes
because these nodes lacking of data.When the new nodes balancer data enough,we can let new
nodes to work.So we can define a new clientDatanode interface to set specific node's bandwidth.

This message was sent by Atlassian JIRA

View raw message