hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Doug Cutting (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-574) want FileSystem implementation for Amazon S3
Date Fri, 10 Nov 2006 17:48:39 GMT
    [ http://issues.apache.org/jira/browse/HADOOP-574?page=comments#action_12448810 ] 
            
Doug Cutting commented on HADOOP-574:
-------------------------------------

> I've started work 

Great!  Jim Kellerman (jim at powerset dot com)  has also privately expressed interest in
implementing this.  Perhaps you can collaborate?

> which package should this go in? org.hadoop.s3fs or org.hadoop.fs.s3, or something else?

Let's go with org.apache.hadoop.fs.s3.  Someday we should probably move dfs into a subpackage
of fs...

Are you going to attack HADOOP-571 too, or is anyone else working on that?  Otherwise it will
be hard to configure a cluster whose default filesystem is S3, or to submit a MapReduce job
whose input or output use a non-default filesystem.


> want FileSystem implementation for Amazon S3
> --------------------------------------------
>
>                 Key: HADOOP-574
>                 URL: http://issues.apache.org/jira/browse/HADOOP-574
>             Project: Hadoop
>          Issue Type: New Feature
>          Components: fs
>            Reporter: Doug Cutting
>
> An S3-based Hadoop FileSystem would make a great addition to Hadoop.
> It would facillitate use of Hadoop on Amazon's EC2 computing grid, as discussed here:
> http://www.mail-archive.com/hadoop-user@lucene.apache.org/msg00318.html
> This is related to HADOOP-571, which would make Hadoop's FileSystem considerably easier
to extend.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message