hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chris Douglas (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-13037) Azure Data Lake Client: Support Azure data lake as a file system in Hadoop
Date Tue, 08 Nov 2016 05:48:58 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-13037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15646602#comment-15646602
] 

Chris Douglas commented on HADOOP-13037:
----------------------------------------

Thanks, everyone. I wasn't sure if this was set for a handful of cases (e.g., not updating
timestamps). ADLS shouldn't behave like a blobstore, generally.

bq. I'll be delayed on testing the rebased patch that I mentioned. HADOOP-13687 likely will
get committed without moving ADL in the source tree

Makes sense. We can move ADLS after updating the contract tests.

> Azure Data Lake Client: Support Azure data lake as a file system in Hadoop
> --------------------------------------------------------------------------
>
>                 Key: HADOOP-13037
>                 URL: https://issues.apache.org/jira/browse/HADOOP-13037
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: fs, fs/azure, tools
>            Reporter: Shrikant Naidu
>            Assignee: Vishwajeet Dusane
>             Fix For: 2.9.0
>
>         Attachments: HADOOP-13037 Proposal.pdf, HADOOP-13037-001.patch, HADOOP-13037-002.patch,
HADOOP-13037-003.patch, HADOOP-13037-004.patch, HADOOP-13037.005.patch, HADOOP-13037.006.patch
>
>
> The jira proposes an improvement over HADOOP-12666 to remove webhdfs dependencies from
the ADL file system client and build out a standalone client. At a high level, this approach
would extend the Hadoop file system class to provide an implementation for accessing Azure
Data Lake. The scheme used for accessing the file system will continue to be 
> adl://<accountname>.azuredatalake.net/path/to/file. 
> The Azure Data Lake Cloud Store will continue to provide a webHDFS rest interface. The
client will  access the ADLS store using WebHDFS Rest APIs provided by the ADLS store. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message