hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vishwajeet Dusane (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-13037) Azure Data Lake Client: Support Azure data lake as a file system in Hadoop
Date Tue, 08 Nov 2016 09:18:58 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-13037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15646989#comment-15646989
] 

Vishwajeet Dusane commented on HADOOP-13037:
--------------------------------------------

[~fabbri] - For contract test related changes and comments from [~stevel@apache.org] and [~cnauroth]
captured in HADOOP-13257. I will be raising a separate patch for contract test related optimization
and correction as [proposed|https://issues.apache.org/jira/browse/HADOOP-13037?focusedCommentId=15627882&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-15627882]
by [~chris.douglas] under HADOOP-13257 task once HADOOP-13037 is committed.

HADOOP-13257 would cover {{org.junit.Assume.assumeTrue(AdlStorageConfiguration.isContractTestEnabled());}}
like usage optimizations.

> Azure Data Lake Client: Support Azure data lake as a file system in Hadoop
> --------------------------------------------------------------------------
>
>                 Key: HADOOP-13037
>                 URL: https://issues.apache.org/jira/browse/HADOOP-13037
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: fs, fs/azure, tools
>            Reporter: Shrikant Naidu
>            Assignee: Vishwajeet Dusane
>             Fix For: 2.9.0
>
>         Attachments: HADOOP-13037 Proposal.pdf, HADOOP-13037-001.patch, HADOOP-13037-002.patch,
HADOOP-13037-003.patch, HADOOP-13037-004.patch, HADOOP-13037.005.patch, HADOOP-13037.006.patch
>
>
> The jira proposes an improvement over HADOOP-12666 to remove webhdfs dependencies from
the ADL file system client and build out a standalone client. At a high level, this approach
would extend the Hadoop file system class to provide an implementation for accessing Azure
Data Lake. The scheme used for accessing the file system will continue to be 
> adl://<accountname>.azuredatalake.net/path/to/file. 
> The Azure Data Lake Cloud Store will continue to provide a webHDFS rest interface. The
client will  access the ADLS store using WebHDFS Rest APIs provided by the ADLS store. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message