hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Abin Shahab (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-8511) Nodegroup locality does not pick the right data-local node for writes
Date Mon, 01 Jun 2015 23:19:17 GMT
Abin Shahab created HDFS-8511:
---------------------------------

             Summary: Nodegroup locality does not pick the right data-local node for writes
                 Key: HDFS-8511
                 URL: https://issues.apache.org/jira/browse/HDFS-8511
             Project: Hadoop HDFS
          Issue Type: Bug
            Reporter: Abin Shahab
            Priority: Critical


Setting up Nodegroup locality destroys data-local writes if NM and DN have separate ip addresses.

When NM requests Namenode for 3 DN locations to write to(for replication=3), the Namenode
returns a random order every time.

The reason is, Namenode wrongly assumes that it's list of DN's must include the NM's ip address.
This assumption breaks down when you deploy NM and DN on separate machines/ip addresses.





--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message