hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chris Trezzo (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-8876) Make hard coded parameters used by balancer and other tools configurable
Date Fri, 07 Aug 2015 18:13:48 GMT

    [ https://issues.apache.org/jira/browse/HDFS-8876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14662190#comment-14662190
] 

Chris Trezzo commented on HDFS-8876:
------------------------------------

[~jingzhao] will do!

> Make hard coded parameters used by balancer and other tools configurable
> ------------------------------------------------------------------------
>
>                 Key: HDFS-8876
>                 URL: https://issues.apache.org/jira/browse/HDFS-8876
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>            Reporter: Ming Ma
>            Assignee: Chris Trezzo
>
> During investigation of how to speed up balancer, at least to the level specified by
{{dfs.datanode.balance.bandwidthPerSec}}, we found that parameters such as {{MAX_BLOCKS_SIZE_TO_FETCH}}
and {{SOURCE_BLOCKS_MIN_SIZE}} are hard coded. These parameters are related to block size
and other configurable parameters used by balancer. So least we should make it configurable.
In the longer term, it might be interesting to understand if we simplify all these related
configurations. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message