hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tom White (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-574) want FileSystem implementation for Amazon S3
Date Wed, 13 Dec 2006 21:47:24 GMT
     [ http://issues.apache.org/jira/browse/HADOOP-574?page=all ]

Tom White updated HADOOP-574:
-----------------------------

    Attachment: HADOOP-574-v3.patch

Here is a version that works with the changes made in HADOOP-571 that are now in trunk.

The unit test TestJets3tS3FileSystem runs against S3 and requires an S3 account - it should
be excluded from the mainline tests and run nightly perhaps (I have not made the changes to
the build file to do this). TestInMemoryS3FileSystem should stay in the mainline tests.

There is some further work to make the implementation more robust (by implementing retries),
but I believe the code is ready to be committed.

> want FileSystem implementation for Amazon S3
> --------------------------------------------
>
>                 Key: HADOOP-574
>                 URL: http://issues.apache.org/jira/browse/HADOOP-574
>             Project: Hadoop
>          Issue Type: New Feature
>          Components: fs
>    Affects Versions: 0.9.0
>            Reporter: Doug Cutting
>             Fix For: 0.10.0
>
>         Attachments: dependencies.zip, HADOOP-574-v2.patch, HADOOP-574-v3.patch, HADOOP-574.patch
>
>
> An S3-based Hadoop FileSystem would make a great addition to Hadoop.
> It would facillitate use of Hadoop on Amazon's EC2 computing grid, as discussed here:
> http://www.mail-archive.com/hadoop-user@lucene.apache.org/msg00318.html
> This is related to HADOOP-571, which would make Hadoop's FileSystem considerably easier
to extend.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message