hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kai Zheng (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-12756) Incorporate Aliyun OSS file system implementation
Date Fri, 24 Jun 2016 22:03:16 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-12756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15348761#comment-15348761
] 

Kai Zheng commented on HADOOP-12756:
------------------------------------

Thanks [~stevel@apache.org] and [~cnauroth] for providing the thoughts! You two great guys
asked for a feature branch for this, according to the latest discussion in the community,
I thought we should probably have it then. I'm not sure the development guys here are familiar
with the approach, but let me expain about it to them by off-line first. I personally feel
that, with the feature branch, it could be even faster to get all the thing ready and delivered,
if it's wanted.

A question could you help clarify, Chris:
bq. a way for committers to run the contract tests integrated with the live service.
According to our previous discussion, a committer to prepare for committing the codes (now
the branch to merge) could run the tests using the way we do for existing cloud modules. Sure
for long term, we need to think about a perfect solution for such live service integrations,
look like [~stevel@apache.org] has already some ideas and even work about this.

> Incorporate Aliyun OSS file system implementation
> -------------------------------------------------
>
>                 Key: HADOOP-12756
>                 URL: https://issues.apache.org/jira/browse/HADOOP-12756
>             Project: Hadoop Common
>          Issue Type: New Feature
>          Components: fs
>    Affects Versions: 2.8.0
>            Reporter: shimingfei
>            Assignee: shimingfei
>         Attachments: HADOOP-12756-v02.patch, HADOOP-12756.003.patch, HADOOP-12756.004.patch,
HADOOP-12756.005.patch, HADOOP-12756.006.patch, HCFS User manual.md, OSS integration.pdf,
OSS integration.pdf
>
>
> Aliyun OSS is widely used among China’s cloud users, but currently it is not easy to
access data laid on OSS storage from user’s Hadoop/Spark application, because of no original
support for OSS in Hadoop.
> This work aims to integrate Aliyun OSS with Hadoop. By simple configuration, Spark/Hadoop
applications can read/write data from OSS without any code change. Narrowing the gap between
user’s APP and data storage, like what have been done for S3 in Hadoop 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message