hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Steve Loughran <ste...@hortonworks.com>
Subject Re: Need to add fs shim to use QFS
Date Fri, 26 Oct 2012 17:32:05 GMT
On 26 October 2012 01:24, Thilee Subramaniam <thilee@quantcast.com> wrote:

> We have made the changes recommended here, and made available a 'Hadoop
> QFS jar' with QFS. This plugin and the QFS libraries will be maintained &
> released by the QFS open-source project.
> Please see the download and usage instructions at
> https://github.com/quantcast/qfs/wiki/Migration-Guide
> The QFS tarball contains a hadoop-qfs jar each for Hadoop 0.23.4, 1.0.2,
> 1.0.4, 1.1.0, and 2.0.2-alpha. Since the interfaces seem similar, I am not
> sure if this is an overkill: one each for trunk and branch1 may suffice.
> Could you comment on this?
Java is a lot more forgiving than C/C++; one built against 1.0.4 should
suffice for all; if you are being over cautious, branch-1 and trunk should
be enough

> Also, is there documentation on Apache Hadoop website that describe
> available alternatives to HDFS (or how to add an alternative file system
> to Hadoop)? Please let us know.
If there isn't something on wiki.apache.org/hadoop there should be: create
a login there, then email back your username and you can have the editor
rights to put something up -I'd suggest a page on "Alternate Filesystems"


  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message