hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yuanbo Liu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-10564) UNDER MIN REPL'D BLOCKS should be prioritized for replication
Date Fri, 08 Jul 2016 06:53:11 GMT

    [ https://issues.apache.org/jira/browse/HDFS-10564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15367308#comment-15367308
] 

Yuanbo Liu commented on HDFS-10564:
-----------------------------------

[~eclark] Actually blocks which need to be replicated have redundancy priority, you can find
more details from {{LowRedundancyBlocks#getPriorityContiguous}}. Only replication <= 1
in some cases will be considered as highest priority. 

> UNDER MIN REPL'D BLOCKS should be prioritized for replication
> -------------------------------------------------------------
>
>                 Key: HDFS-10564
>                 URL: https://issues.apache.org/jira/browse/HDFS-10564
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>            Reporter: Elliott Clark
>
> When datanodes get drained they are probably being drained because the hardware is bad,
or suspect. The blocks that have no live nodes should be prioritized. However it appears not
to be the case at all.
> Draining full nodes with lots of blocks but only a handful of under min replicated blocks
takes about the full time before fsck reports clean again.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message