hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eli Collins (Created) (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-3218) The client should be able to use multiple remote DN interfaces for block transfer
Date Fri, 06 Apr 2012 17:25:22 GMT
The client should be able to use multiple remote DN interfaces for block transfer
---------------------------------------------------------------------------------

                 Key: HDFS-3218
                 URL: https://issues.apache.org/jira/browse/HDFS-3218
             Project: Hadoop HDFS
          Issue Type: Sub-task
          Components: hdfs client
            Reporter: Eli Collins
            Assignee: Eli Collins


HDFS-3146 and HDFS-3216 expose multiple DN interfaces to the client. In order for clients,
in aggregate, to use multiple DN interfaces clients should pick different interfaces when
transferring blocks. Given that we cache client <-> DN connections the policy of picking
a remote interface at random for each new connection seems best (vs round robin for example).
In the future we could make the client congestion aware. We could also establish multiple
connections between the client and DN and therefore use multiple interfaces for a single block
transfer. Both of those are out of scope for this jira.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message