hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tom White (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-8545) Filesystem Implementation for OpenStack Swift
Date Wed, 12 Dec 2012 10:35:24 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13529812#comment-13529812
] 

Tom White commented on HADOOP-8545:
-----------------------------------

I'm not sure whether the blockstore implementation is the right approach. The main drawback
is that it's a Hadoop-specific format, which other tools can't read, and which will introduce
a support burden. The S3 blockstore was introduced when there was a limit on the size of files,
which has since been removed, so if I was doing it today I would probably not have a S3 blockstore
implementation. I would encourage you to look at more general support for large files in Swift,
e.g. http://docs.openstack.org/developer/swift/overview_large_objects.html.
                
> Filesystem Implementation for OpenStack Swift
> ---------------------------------------------
>
>                 Key: HADOOP-8545
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8545
>             Project: Hadoop Common
>          Issue Type: New Feature
>          Components: fs
>    Affects Versions: 2.0.3-alpha, 1.1.2
>            Reporter: Tim Miller
>            Priority: Minor
>         Attachments: HADOOP-8545-1.patch, HADOOP-8545-javaclouds-2.patch, HADOOP-8545.patch,
HADOOP-8545.patch
>
>
> Add a filesystem implementation for OpenStack Swift object store, similar to the one
which exists today for S3.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message