Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id F2798200BE0 for ; Tue, 8 Nov 2016 08:30:01 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id EF428160B0A; Tue, 8 Nov 2016 07:30:01 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 47BF1160B13 for ; Tue, 8 Nov 2016 08:30:01 +0100 (CET) Received: (qmail 53132 invoked by uid 500); 8 Nov 2016 07:30:00 -0000 Mailing-List: contact common-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list common-issues@hadoop.apache.org Received: (qmail 53021 invoked by uid 99); 8 Nov 2016 07:29:59 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 08 Nov 2016 07:29:59 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id A64832C2AB7 for ; Tue, 8 Nov 2016 07:29:59 +0000 (UTC) Date: Tue, 8 Nov 2016 07:29:59 +0000 (UTC) From: "Chris Douglas (JIRA)" To: common-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HADOOP-13037) Azure Data Lake Client: Support Azure data lake as a file system in Hadoop MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Tue, 08 Nov 2016 07:30:02 -0000 [ https://issues.apache.org/jira/browse/HADOOP-13037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15646776#comment-15646776 ] Chris Douglas commented on HADOOP-13037: ---------------------------------------- I tested some basic shell operations against ADLS using v006 and {{ClientCredential}} auth. I'll commit this in a day or two. [~fabbri], [~cnauroth], [~eddyxu], [~stevel@apache.org]: this seems to address the followup feedback from HADOOP-12666, particularly removing the WebHDFS dependency. Do you want to verify this before it's committed? > Azure Data Lake Client: Support Azure data lake as a file system in Hadoop > -------------------------------------------------------------------------- > > Key: HADOOP-13037 > URL: https://issues.apache.org/jira/browse/HADOOP-13037 > Project: Hadoop Common > Issue Type: Improvement > Components: fs, fs/azure, tools > Reporter: Shrikant Naidu > Assignee: Vishwajeet Dusane > Fix For: 2.9.0 > > Attachments: HADOOP-13037 Proposal.pdf, HADOOP-13037-001.patch, HADOOP-13037-002.patch, HADOOP-13037-003.patch, HADOOP-13037-004.patch, HADOOP-13037.005.patch, HADOOP-13037.006.patch > > > The jira proposes an improvement over HADOOP-12666 to remove webhdfs dependencies from the ADL file system client and build out a standalone client. At a high level, this approach would extend the Hadoop file system class to provide an implementation for accessing Azure Data Lake. The scheme used for accessing the file system will continue to be > adl://.azuredatalake.net/path/to/file. > The Azure Data Lake Cloud Store will continue to provide a webHDFS rest interface. The client will access the ADLS store using WebHDFS Rest APIs provided by the ADLS store. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org For additional commands, e-mail: common-issues-help@hadoop.apache.org