hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Wangda Tan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-11310) Reduce the performance impact of the balancer (trunk port)
Date Tue, 06 Feb 2018 03:17:00 GMT

    [ https://issues.apache.org/jira/browse/HDFS-11310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16353286#comment-16353286
] 

Wangda Tan commented on HDFS-11310:
-----------------------------------

Thanks [~daryn] for reporting this issue. We plan to start merge vote of 3.1.0 on Feb 18,
please let me know if any plan to finish this by Feb 18 or we need to move it out.

> Reduce the performance impact of the balancer (trunk port)
> ----------------------------------------------------------
>
>                 Key: HDFS-11310
>                 URL: https://issues.apache.org/jira/browse/HDFS-11310
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: hdfs, namenode
>    Affects Versions: 3.0.0-alpha1
>            Reporter: Daryn Sharp
>            Priority: Critical
>
> HDFS-7967 introduced a highly performant balancer getBlocks() query that scales to large/dense
clusters.  The simple design implementation depends on the triplets data structure.  HDFS-9260
removed the triplets which fundamentally changes the implementation.  Either that patch must
be reverted or the getBlocks() patch needs reimplementation.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message