hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eli Collins (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-2683) Authority-based lookup of proxy provider fails if path becomes canonicalized
Date Thu, 15 Dec 2011 00:09:31 GMT

    [ https://issues.apache.org/jira/browse/HDFS-2683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13169841#comment-13169841
] 

Eli Collins commented on HDFS-2683:
-----------------------------------

Why not reject logical names with port numbers instead of warn?  Patch lgtm.
                
> Authority-based lookup of proxy provider fails if path becomes canonicalized
> ----------------------------------------------------------------------------
>
>                 Key: HDFS-2683
>                 URL: https://issues.apache.org/jira/browse/HDFS-2683
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: ha, hdfs client
>    Affects Versions: HA branch (HDFS-1623)
>            Reporter: Todd Lipcon
>            Assignee: Todd Lipcon
>            Priority: Critical
>         Attachments: hdfs-2683.txt
>
>
> When testing MapReduce on top of an HA cluster we ran into the following bug: some uses
of HDFS paths go through a canonicalization step which ensures that the authority component
in the URI includes a port number. So our hdfs://logical-nn-uri/foo path turned into hdfs://logical-nn-uri:8020/foo.
The code which looks up the failover proxy provider then failed to find the associated config.
We should only compare the hostname portion of the URI when looking up proxy providers.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message