hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jing Zhao (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-9083) Replication violates block placement policy.
Date Mon, 26 Oct 2015 18:55:27 GMT

    [ https://issues.apache.org/jira/browse/HDFS-9083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14974829#comment-14974829

Jing Zhao commented on HDFS-9083:

Thanks for working on this, [~rushabh.shah]. Yes, we need to fix this in branch-2.7 and currently
this is a blocker for 2.7.2.

> Replication violates block placement policy.
> --------------------------------------------
>                 Key: HDFS-9083
>                 URL: https://issues.apache.org/jira/browse/HDFS-9083
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: HDFS, namenode
>    Affects Versions: 2.6.0
>            Reporter: Rushabh S Shah
>            Assignee: Rushabh S Shah
>            Priority: Blocker
> Recently we are noticing many cases in which all the replica of the block are residing
on the same rack.
> During the block creation, the block placement policy was honored.
> But after node failure event in some specific manner, the block ends up in such state.
> On investigating more I found out that BlockManager#blockHasEnoughRacks is dependent
on the config (net.topology.script.file.name)
> {noformat}
>  if (!this.shouldCheckForEnoughRacks) {
>       return true;
>     }
> {noformat}
> We specify DNSToSwitchMapping implementation (our own custom implementation) via net.topology.node.switch.mapping.impl
and no longer use net.topology.script.file.name config.

This message was sent by Atlassian JIRA

View raw message