Mailing-List: contact common-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: common-issues@hadoop.apache.org
Date: Mon, 15 Jul 2013 20:30:55 +0000 (UTC)
From: "Noah Watkins (JIRA)" <jira@apache.org>
To: common-issues@hadoop.apache.org
Message-ID: <JIRA.12435471.1252699564407.52952.1373920255432@arcas>
In-Reply-To: <JIRA.12435471.1252699564407@arcas>
References: <JIRA.12435471.1252699564407@arcas>
Subject: [jira] [Commented] (HADOOP-6253) Add a Ceph FileSystem interface.
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


    [ https://issues.apache.org/jira/browse/HADOOP-6253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13708940#comment-13708940 ] 

Noah Watkins commented on HADOOP-6253:
--------------------------------------

Hi Steve,

Noah, I've been doing work in HADOOP-9361 both with trying to specify more

I'd be happy to! One of the biggest things we have run into is figuring out
what the contract is. Inferring it from the behavior of applications has
been our only real resource for that information. We have done some ad-hoc
stuff in which we have adapted HDFS tests to run against Ceph, but it is
pretty ugly and difficult to maintain.

 One thing that we have run into recently with a user is diagnosing some
write performance problems. HDFS is performing well, and we think small
writes might be a culprit if Ceph isn't doing write buffering.
Understanding what that contract is, especially in terms of write safety is
another area slightly different than just unit tests that we are interested
in.


Ahh, that would be cool. Certainly easier to merge changes to that than
accept an entire new file system upstream :)

Let me know how I get can started helping out.

-Noah

                
> Add a Ceph FileSystem interface.
> --------------------------------
>
>                 Key: HADOOP-6253
>                 URL: https://issues.apache.org/jira/browse/HADOOP-6253
>             Project: Hadoop Common
>          Issue Type: New Feature
>          Components: fs
>            Reporter: Gregory Farnum
>            Assignee: Gregory Farnum
>            Priority: Minor
>              Labels: ceph
>         Attachments: HADOOP-6253.patch, HADOOP-6253.patch, HADOOP-6253.patch, HADOOP-6253.patch, HADOOP-6253.patch
>
>
> The experimental distributed filesystem Ceph does not have a single point of failure, uses a distributed metadata cluster instead of a single in-memory server, and might be of use to some Hadoop users.
> http://ceph.com/docs/wip-hadoop-doc/cephfs/hadoop/

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira