hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-13037) Azure Data Lake Client: Support Azure data lake as a file system in Hadoop
Date Mon, 07 Nov 2016 10:17:58 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-13037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15643734#comment-15643734
] 

Steve Loughran commented on HADOOP-13037:
-----------------------------------------

bq. I'm not familiar with this parameter. 

{{fs.contract.is-blobstore}} tells the tests that this an object store and expect consistency
to be unpredictable. In HADOOP-13502 [~cnauroth] split up the marker to be more specific on
the expected behaviour an FS can declare; this property is still the main one

> Azure Data Lake Client: Support Azure data lake as a file system in Hadoop
> --------------------------------------------------------------------------
>
>                 Key: HADOOP-13037
>                 URL: https://issues.apache.org/jira/browse/HADOOP-13037
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: fs, fs/azure, tools
>            Reporter: Shrikant Naidu
>            Assignee: Vishwajeet Dusane
>             Fix For: 2.9.0
>
>         Attachments: HADOOP-13037 Proposal.pdf, HADOOP-13037-001.patch, HADOOP-13037-002.patch,
HADOOP-13037-003.patch, HADOOP-13037-004.patch, HADOOP-13037.005.patch
>
>
> The jira proposes an improvement over HADOOP-12666 to remove webhdfs dependencies from
the ADL file system client and build out a standalone client. At a high level, this approach
would extend the Hadoop file system class to provide an implementation for accessing Azure
Data Lake. The scheme used for accessing the file system will continue to be 
> adl://<accountname>.azuredatalake.net/path/to/file. 
> The Azure Data Lake Cloud Store will continue to provide a webHDFS rest interface. The
client will  access the ADLS store using WebHDFS Rest APIs provided by the ADLS store. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message