hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ming Ma (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-9922) Upgrade Domain placement policy status marks a good block in violation when there are decommissioned nodes
Date Fri, 21 Apr 2017 22:09:04 GMT

    [ https://issues.apache.org/jira/browse/HDFS-9922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15979473#comment-15979473
] 

Ming Ma commented on HDFS-9922:
-------------------------------

Currently upgrade domain isn't considered available in 2.8 due to these changes. If we want
the feature to be in 2.8, the major backport item is HDFS-9005.

> Upgrade Domain placement policy status marks a good block in violation when there are
decommissioned nodes
> ----------------------------------------------------------------------------------------------------------
>
>                 Key: HDFS-9922
>                 URL: https://issues.apache.org/jira/browse/HDFS-9922
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Chris Trezzo
>            Assignee: Chris Trezzo
>            Priority: Minor
>             Fix For: 2.9.0, 3.0.0-alpha1
>
>         Attachments: HDFS-9922-trunk-v1.patch, HDFS-9922-trunk-v2.patch, HDFS-9922-trunk-v3.patch,
HDFS-9922-trunk-v4.patch
>
>
> When there are replicas of a block on a decommissioned node, BlockPlacementStatusWithUpgradeDomain#isUpgradeDomainPolicySatisfied
returns false when it should return true. This is because numberOfReplicas is the number of
in-service replicas for the block and upgradeDomains.size() is the number of upgrade domains
across all replicas of the block. Specifically, we hit this scenario when numberOfReplicas
is equal to upgradeDomainFactor and upgradeDomains.size() is greater than numberOfReplicas.
> {code}
> private boolean isUpgradeDomainPolicySatisfied() {
>     if (numberOfReplicas <= upgradeDomainFactor) {
>       return (numberOfReplicas == upgradeDomains.size());
>     } else {
>       return upgradeDomains.size() >= upgradeDomainFactor;
>     }
>   }
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message