hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Owen O'Malley (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-2326) hftp token renewal uses wrong port
Date Tue, 13 Sep 2011 16:09:08 GMT

    [ https://issues.apache.org/jira/browse/HDFS-2326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13103717#comment-13103717
] 

Owen O'Malley commented on HDFS-2326:
-------------------------------------

I tried the case of using HftpFileSystem, both directly from the command line:

{quote}
% hadoop fs -ls hftp://nn:hp/my-dir
% hadoop fs -cat hftp://nn:hp/my-file
% hadoop distcp hftp://nn:hp/my-dir hdfs://nn:rp/copy-dir
{quote}

During the distcp job, I ensured that the JobTracker successfully renewed both the hdfs and
hftp tokens.

I also tried hftp with a token that I acquired using fetchdt using both http and rpc.

{quote}
% hadoop fetchdt --webservice https://nn:shp my.tok
% export HADOOP_TOKEN_FILE_LOCATION my.tok
% hadoop fs -ls hftp://nn:hp/my-dir
% hadoop fs -cat hftp://nn:hp/my-file
% (repeat with rpc token)
{quote}

> hftp token renewal uses wrong port
> ----------------------------------
>
>                 Key: HDFS-2326
>                 URL: https://issues.apache.org/jira/browse/HDFS-2326
>             Project: Hadoop HDFS
>          Issue Type: Bug
>    Affects Versions: 0.20.205.0
>            Reporter: Daryn Sharp
>            Priority: Critical
>             Fix For: 0.20.205.0
>
>
> MAPREDUCE-2764 introduced a new method for token renewal.  The change appears to have
a problem renewing hftp tokens.  The {{setDelegationToken}} method will reset the token's
service to contain the remote rpc port.  However, the renewer expects it to be the remote
https port.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message