hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Craig Macdonald <cra...@dcs.gla.ac.uk>
Subject Re: Hadoop+s3 & fuse-dfs
Date Wed, 28 Jan 2009 19:03:10 GMT
Hi Roopa,

I cant comment on the S3 specifics. However, fuse-dfs is based on a C 
interface called libhdfs which allows C programs (such as fuse-dfs) to 
connect to the Hadoop file system Java API. This being the case, 
fuse-dfs should (theoretically) be able to connect to any file system 
that Hadoop can. Your mileage may vary, but if you find issues, please 
do report them through the normal channels.


Roopa Sudheendra wrote:
> I am experimenting with Hadoop backed by Amazon s3 filesystem as one 
> of our backup storage solution. Just the hadoop and s3(block based 
> since it overcomes the 5gb limit) so far seems to be fine.
> My problem is that i want to mount this filesystem using fuse-dfs ( 
> since i don't have to worry about how the file is written on the 
> system ) . Since the namenode does not get started with s3 backed 
> hadoop system how can i connect fuse-dfs to this setup.
> Appreciate your help.
> Thanks,
> Roopa

View raw message