Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 534F7200CD0 for ; Tue, 11 Jul 2017 04:03:53 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 51B85164E41; Tue, 11 Jul 2017 02:03:53 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 98307164E3D for ; Tue, 11 Jul 2017 04:03:52 +0200 (CEST) Received: (qmail 77729 invoked by uid 500); 11 Jul 2017 02:03:51 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 77703 invoked by uid 99); 11 Jul 2017 02:03:50 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 11 Jul 2017 02:03:50 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id D3907194F3B for ; Tue, 11 Jul 2017 02:03:49 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -99.202 X-Spam-Level: X-Spam-Status: No, score=-99.202 tagged_above=-999 required=6.31 tests=[KAM_ASCII_DIVIDERS=0.8, RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id 0MuhN5x0H0lI for ; Tue, 11 Jul 2017 02:03:49 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTP id 3358562E15 for ; Tue, 11 Jul 2017 01:55:03 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id E3AA2E0D33 for ; Tue, 11 Jul 2017 01:55:01 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 681B8246B5 for ; Tue, 11 Jul 2017 01:55:00 +0000 (UTC) Date: Tue, 11 Jul 2017 01:55:00 +0000 (UTC) From: "John Zhuge (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Comment Edited] (HDFS-12052) Set SWEBHDFS delegation token kind when ssl is enabled in HttpFS MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Tue, 11 Jul 2017 02:03:53 -0000 [ https://issues.apache.org/jira/browse/HDFS-12052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16081494#comment-16081494 ] John Zhuge edited comment on HDFS-12052 at 7/11/17 1:54 AM: ------------------------------------------------------------ Clicked the link https://builds.apache.org/job/PreCommit-HDFS-Build/20219/artifact/patchprocess/diff-checkstyle-hadoop-hdfs-project_hadoop-hdfs-httpfs.txt: {noformat} ./hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/fs/http/server/HttpFSAuthenticationFilter.java:22:import org.apache.hadoop.fs.http.server.HttpFSServerWebServer;:1: Redundant import from the same package - org.apache.hadoop.fs.http.server.HttpFSServerWebServer. [RedundantImport] {noformat} was (Author: jzhuge): Clicked the link https://builds.apache.org/job/PreCommit-HDFS-Build/20219/artifact/patchprocess/diff-checkstyle-hadoop-hdfs-project_hadoop-hdfs-httpfs.txt: {noformat} ./hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/fs/http/server/HttpFSAuthenticationFilter.java:22:import org.apache.hadoop.fs.http.server.HttpFSServerWebServer;:1: Redundant import from the same package - org.apache.hadoop.fs.http.server.HttpFSServerWebServer. [RedundantImport] {noformat} > Set SWEBHDFS delegation token kind when ssl is enabled in HttpFS > ---------------------------------------------------------------- > > Key: HDFS-12052 > URL: https://issues.apache.org/jira/browse/HDFS-12052 > Project: Hadoop HDFS > Issue Type: Bug > Components: httpfs, webhdfs > Affects Versions: 2.7.3, 3.0.0-alpha3 > Reporter: Zoran Dimitrijevic > Assignee: Zoran Dimitrijevic > Attachments: HDFS-12052.00.patch, HDFS-12052.01.patch, HDFS-12052.02.patch, HDFS-12052.03.patch, HDFS-12052.04.patch, HDFS-12052.05.patch, HDFS-12052.06.patch > > > When httpfs runs with httpfs.ssl.enabled it should return SWEBHDFS delegation tokens. > Currently, httpfs returns WEBHDFS delegation "kind" for tokens regardless of whether ssl is enabled or not. If clients directly connect to renew tokens (for example, hdfs dfs) all works because httpfs doesn't check whether token kind is for swebhdfs or webhdfs. However, this breaks when yarn rm needs to renew the token for the job (for example, when running hadoop distcp). Since DT kind is WEBHDFS, rm tries to establish non-ssl connection to httpfs and fails. > I've tested a simple patch which I'll upload to this jira, and it fixes this issue (hadoop distcp works). -- This message was sent by Atlassian JIRA (v6.4.14#64029) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org