hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Doug Cutting (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-1963) Code contribution of Kosmos Filesystem implementation of Hadoop Filesystem interface
Date Tue, 02 Oct 2007 22:25:50 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-1963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12531934

Doug Cutting commented on HADOOP-1963:

My sense is that 'URI.create("kfs://dev104:20000/")' could be replaced with something like
'URI.create("kfs://bogus/")', since no network access should be made during this test.  Is
that right?

The version of the FileSystem API that's implemented by this patch is not the current trunk
version.  In particular, getFileStatus() must be implemented, listFileStatus() should be implemented
instead of listPaths(), and many other deprecated methods should not be implemented (getReplication,
isDirectory, getLength, etc.), but instead rely on the base class implementation in terms
of getFileStatus().

Finally, the bufferSize parameter is no longer supported by FSDataInputStream and FSDataOutputStream.
 Instead, one should interpolate a BufferedInputStream and an FSBufferedInputStream respectively
to add buffering to KFS's streams.

> Code contribution of Kosmos Filesystem implementation of Hadoop Filesystem interface
> ------------------------------------------------------------------------------------
>                 Key: HADOOP-1963
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1963
>             Project: Hadoop
>          Issue Type: New Feature
>          Components: fs
>            Reporter: Sriram Rao
>         Attachments: kfs-hadoop.tar.gz
> Kosmos Filesystem (KFS) is an open source implementation targeted towards applications
that are required to process large amounts of data.  KFS has been integrated with Hadoop using
Hadoop's filesystem interfaces.  This issue is filed with the intent of getting our code,
namely, fs/kfs classes, to be included in the next Hadoop release.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message