hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Haohui Mai (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-5891) webhdfs should not try connecting the DN during redirection
Date Wed, 05 Feb 2014 22:48:12 GMT
Haohui Mai created HDFS-5891:
--------------------------------

             Summary: webhdfs should not try connecting the DN during redirection
                 Key: HDFS-5891
                 URL: https://issues.apache.org/jira/browse/HDFS-5891
             Project: Hadoop HDFS
          Issue Type: Bug
            Reporter: Haohui Mai
            Assignee: Haohui Mai


When the webhdfs server in NN serves an {{OPEN}} request, the NN will eventually redirect
the request to a DN. The current implementation intends to choose the active DNs. The code
always connects to the DN in a deterministic order to see whether it is active during redirection.

Although it reduces the chance of the client from connecting to a failed DN, this is problematic
because:

# It has no guarantees that the client can connect to that DN even if the NN can connect to
it.
# It requires an additional network round-trip for every {{OPEN}} / {{CREATE}} request.

This jira proposes that the NN should choose the DN based on the information of the data node
manager.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Mime
View raw message