hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lin Yiqun (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-9375) Set balancer bandwidth for specific node
Date Mon, 23 Nov 2015 10:45:11 GMT

    [ https://issues.apache.org/jira/browse/HDFS-9375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15021933#comment-15021933

Lin Yiqun commented on HDFS-9375:

[~brahmareddy], do you have time to review my patch again? Thanks!

> Set balancer bandwidth for specific node
> ----------------------------------------
>                 Key: HDFS-9375
>                 URL: https://issues.apache.org/jira/browse/HDFS-9375
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: balancer & mover
>    Affects Versions: 2.7.1
>            Reporter: Lin Yiqun
>            Assignee: Lin Yiqun
>         Attachments: HDFS-9375.001.patch, HDFS-9375.002.patch, HDFS-9375.003.patch, HDFS-9375.004.patch
> Now even though the balancer is impove a lot, but In some cases that is still slow. For
example when the cluster is extended,the new nodes all need balancer datas from existed nodes.In
order to improve the balancer velocity,generally,we will use {{setBalancerBandwidth}} of {{dfsadmin}}
command.But this is set for every node, obviously,we can increase more bandwidth for new nodes
because these nodes lacking of data.When the new nodes balancer data enough,we can let new
nodes to work.So we can define a new clientDatanode interface to set specific node's bandwidth.

This message was sent by Atlassian JIRA

View raw message