hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vishwajeet Dusane (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-12666) Support Microsoft Azure Data Lake - as a file system in Hadoop
Date Mon, 29 Feb 2016 17:19:18 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-12666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15172176#comment-15172176

Vishwajeet Dusane commented on HADOOP-12666:

Thank you [~cnauroth]. I am not going to respond on the comments which i agree with you (And
i will incorporate them in the next patch upload along with comments from  [~fabbri]) and
appreciate the detail review.

 * For contract test cases - Will get back on this later.
 * LOG_VERSION is telemetry information used in Adl back-end only.
 * For packaging namespace - [https://reviews.apache.org/r/44169/] has the change that Adl
requires to not use 'org.apache.hadoop.hdfs.web' and reside in org.apache.hadoop.fs.adl only.
[~ajfabbri] - I could not find your user name in the [https://reviews.apache.org/r/44169/]
so please have a look.
 * For Segregation of common properties - Like i mentioned in the earlier comment, can this
not be taken up in separate JIRA? or do you ([~mackrorysd] and [~chris.douglas]) expect it
to be taken care as part of this patch only since OAuth2 is being used by Adl only so far?
 * Thread-safety on FsInputSteam - Will get back on this later.

> Support Microsoft Azure Data Lake - as a file system in Hadoop
> --------------------------------------------------------------
>                 Key: HADOOP-12666
>                 URL: https://issues.apache.org/jira/browse/HADOOP-12666
>             Project: Hadoop Common
>          Issue Type: New Feature
>          Components: fs, fs/azure, tools
>            Reporter: Vishwajeet Dusane
>            Assignee: Vishwajeet Dusane
>         Attachments: HADOOP-12666-002.patch, HADOOP-12666-003.patch, HADOOP-12666-004.patch,
HADOOP-12666-005.patch, HADOOP-12666-006.patch, HADOOP-12666-1.patch
>   Original Estimate: 336h
>          Time Spent: 336h
>  Remaining Estimate: 0h
> h2. Description
> This JIRA describes a new file system implementation for accessing Microsoft Azure Data
Lake Store (ADL) from within Hadoop. This would enable existing Hadoop applications such has
MR, HIVE, Hbase etc..,  to use ADL store as input or output.
> ADL is ultra-high capacity, Optimized for massive throughput with rich management and
security features. More details available at https://azure.microsoft.com/en-us/services/data-lake-store/

This message was sent by Atlassian JIRA

View raw message