hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Wu Weiwei (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-14450) Erasure Coding: decommissioning datanodes cause replicate a large number of duplicate EC internal blocks
Date Tue, 23 Apr 2019 08:05:00 GMT

     [ https://issues.apache.org/jira/browse/HDFS-14450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Wu Weiwei updated HDFS-14450:
-----------------------------
    Summary: Erasure Coding: decommissioning datanodes cause replicate a large number of duplicate
EC internal blocks  (was: Erasure Coding: decommissionning datanodes cause replicate a large
number of duplicate EC internal blocks)

> Erasure Coding: decommissioning datanodes cause replicate a large number of duplicate
EC internal blocks
> --------------------------------------------------------------------------------------------------------
>
>                 Key: HDFS-14450
>                 URL: https://issues.apache.org/jira/browse/HDFS-14450
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Wu Weiwei
>            Assignee: Wu Weiwei
>            Priority: Major
>
> {code:java}
> //  [WARN] [RedundancyMonitor] : Failed to place enough replicas, still in need of 2
to reach 167 (unavailableStorages=[DISK, ARCHIVE], storagePolicy=BlockStoragePolicy{HOT:7,
storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]}, newBlock=false)
All required storage types are unavailable:  unavailableStorages=[DISK, ARCHIVE], storagePolicy=BlockStoragePolicy{HOT:7,
storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]}
> {code}
> In a large-scale cluster, decommissioning large-scale datanodes cause EC block groups
to replicate a large number of duplicate internal blocks.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message