hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-12052) Set SWEBHDFS delegation token kind when ssl is enabled in HttpFS
Date Tue, 11 Jul 2017 18:54:01 GMT

    [ https://issues.apache.org/jira/browse/HDFS-12052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16082754#comment-16082754
] 

Hudson commented on HDFS-12052:
-------------------------------

SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11988 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/11988/])
HDFS-12052. Set SWEBHDFS delegation token kind when ssl is enabled in (jzhuge: rev 12c8fdceaf263425661169cba25402df89d444c1)
* (edit) hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/fs/http/server/HttpFSAuthenticationFilter.java
* (edit) hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/fs/http/server/HttpFSServerWebServer.java
* (edit) hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/fs/http/server/TestHttpFSServer.java
* (edit) hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/fs/http/server/HttpFSKerberosAuthenticationHandlerForTesting.java


> Set SWEBHDFS delegation token kind when ssl is enabled in HttpFS
> ----------------------------------------------------------------
>
>                 Key: HDFS-12052
>                 URL: https://issues.apache.org/jira/browse/HDFS-12052
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: httpfs, webhdfs
>    Affects Versions: 2.7.3, 3.0.0-alpha3
>            Reporter: Zoran Dimitrijevic
>            Assignee: Zoran Dimitrijevic
>             Fix For: 3.0.0-beta1
>
>         Attachments: HDFS-12052.00.patch, HDFS-12052.01.patch, HDFS-12052.02.patch, HDFS-12052.03.patch,
HDFS-12052.04.patch, HDFS-12052.05.patch, HDFS-12052.06.patch, HDFS-12052.07.patch
>
>
> When httpfs runs with httpfs.ssl.enabled it should return SWEBHDFS delegation tokens.

> Currently, httpfs returns WEBHDFS delegation "kind" for tokens regardless of whether
ssl is enabled or not. If clients directly connect to renew tokens (for example, hdfs dfs)
all works because httpfs doesn't check whether token kind is for swebhdfs or webhdfs. However,
this breaks when yarn rm needs to renew the token for the job (for example, when running hadoop
distcp). Since DT kind is WEBHDFS, rm tries to establish non-ssl connection to httpfs and
fails.
> I've tested a simple patch which I'll upload to this jira, and it fixes this issue (hadoop
distcp works).



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message