hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (Created) (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-2492) BlockManager cross-rack replication checks only work for ScriptBasedMapping
Date Sat, 22 Oct 2011 15:49:32 GMT
BlockManager cross-rack replication checks only work for ScriptBasedMapping

                 Key: HDFS-2492
                 URL: https://issues.apache.org/jira/browse/HDFS-2492
             Project: Hadoop HDFS
          Issue Type: Bug
    Affects Versions: 0.23.0, 0.24.0
            Reporter: Steve Loughran

The BlockManager cross-rack replication checks only works if script files are used for replication,
not if alternate plugins provide the topology information.

This is because the BlockManager sets its rack checking flag if there is a filename key
shouldCheckForEnoughRacks = conf.get(DFSConfigKeys.NET_TOPOLOGY_SCRIPT_FILE_NAME_KEY) != null;
yet this filename key is only used if the topology mapper defined by 
is an instance of {{ScriptBasedMapping}}

If any other mapper is used, the system may be multi rack, but the Block Manager will not
be aware of this fact unless the filename key is set to something non-null

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message