hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Haohui Mai (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-5891) webhdfs should not try connecting the DN during redirection
Date Wed, 05 Feb 2014 23:18:08 GMT

     [ https://issues.apache.org/jira/browse/HDFS-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Haohui Mai updated HDFS-5891:

    Attachment: HDFS-5891.000.patch

> webhdfs should not try connecting the DN during redirection
> -----------------------------------------------------------
>                 Key: HDFS-5891
>                 URL: https://issues.apache.org/jira/browse/HDFS-5891
>             Project: Hadoop HDFS
>          Issue Type: Bug
>            Reporter: Haohui Mai
>            Assignee: Haohui Mai
>         Attachments: HDFS-5891.000.patch
> When the webhdfs server in NN serves an {{OPEN}} request, the NN will eventually redirect
the request to a DN. The current implementation intends to choose the active DNs. The code
always connects to the DN in a deterministic order to see whether it is active during redirection.
> Although it reduces the chance of the client from connecting to a failed DN, this is
problematic because:
> # It has no guarantees that the client can connect to that DN even if the NN can connect
to it.
> # It requires an additional network round-trip for every {{OPEN}} / {{CREATE}} request.
> This jira proposes that the NN should choose the DN based on the information of the data
node manager.

This message was sent by Atlassian JIRA

View raw message