hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Todd Lipcon (Resolved) (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (HDFS-2683) Authority-based lookup of proxy provider fails if path becomes canonicalized
Date Thu, 15 Dec 2011 00:43:31 GMT

     [ https://issues.apache.org/jira/browse/HDFS-2683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Todd Lipcon resolved HDFS-2683.
-------------------------------

       Resolution: Fixed
    Fix Version/s: HA branch (HDFS-1623)
     Hadoop Flags: Reviewed

Thanks, committed to branch
                
> Authority-based lookup of proxy provider fails if path becomes canonicalized
> ----------------------------------------------------------------------------
>
>                 Key: HDFS-2683
>                 URL: https://issues.apache.org/jira/browse/HDFS-2683
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: ha, hdfs client
>    Affects Versions: HA branch (HDFS-1623)
>            Reporter: Todd Lipcon
>            Assignee: Todd Lipcon
>            Priority: Critical
>             Fix For: HA branch (HDFS-1623)
>
>         Attachments: hdfs-2683.txt, hdfs-2683.txt
>
>
> When testing MapReduce on top of an HA cluster we ran into the following bug: some uses
of HDFS paths go through a canonicalization step which ensures that the authority component
in the URI includes a port number. So our hdfs://logical-nn-uri/foo path turned into hdfs://logical-nn-uri:8020/foo.
The code which looks up the failover proxy provider then failed to find the associated config.
We should only compare the hostname portion of the URI when looking up proxy providers.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message