hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Owen O'Malley (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-2326) hftp token renewal uses wrong port
Date Tue, 13 Sep 2011 16:09:08 GMT

    [ https://issues.apache.org/jira/browse/HDFS-2326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13103717#comment-13103717

Owen O'Malley commented on HDFS-2326:

I tried the case of using HftpFileSystem, both directly from the command line:

% hadoop fs -ls hftp://nn:hp/my-dir
% hadoop fs -cat hftp://nn:hp/my-file
% hadoop distcp hftp://nn:hp/my-dir hdfs://nn:rp/copy-dir

During the distcp job, I ensured that the JobTracker successfully renewed both the hdfs and
hftp tokens.

I also tried hftp with a token that I acquired using fetchdt using both http and rpc.

% hadoop fetchdt --webservice https://nn:shp my.tok
% hadoop fs -ls hftp://nn:hp/my-dir
% hadoop fs -cat hftp://nn:hp/my-file
% (repeat with rpc token)

> hftp token renewal uses wrong port
> ----------------------------------
>                 Key: HDFS-2326
>                 URL: https://issues.apache.org/jira/browse/HDFS-2326
>             Project: Hadoop HDFS
>          Issue Type: Bug
>    Affects Versions:
>            Reporter: Daryn Sharp
>            Priority: Critical
>             Fix For:
> MAPREDUCE-2764 introduced a new method for token renewal.  The change appears to have
a problem renewing hftp tokens.  The {{setDelegationToken}} method will reset the token's
service to contain the remote rpc port.  However, the renewer expects it to be the remote
https port.

This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message