Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 3ECB27154 for ; Fri, 23 Dec 2011 18:49:13 +0000 (UTC) Received: (qmail 56444 invoked by uid 500); 23 Dec 2011 18:49:09 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 56371 invoked by uid 500); 23 Dec 2011 18:49:09 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 56264 invoked by uid 500); 23 Dec 2011 18:49:09 -0000 Delivered-To: apmail-hadoop-hbase-user@hadoop.apache.org Received: (qmail 56168 invoked by uid 99); 23 Dec 2011 18:49:09 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 23 Dec 2011 18:49:09 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=5.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of todd@cloudera.com designates 209.85.215.48 as permitted sender) Received: from [209.85.215.48] (HELO mail-lpp01m010-f48.google.com) (209.85.215.48) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 23 Dec 2011 18:49:02 +0000 Received: by laam7 with SMTP id m7so5268660laa.35 for ; Fri, 23 Dec 2011 10:48:42 -0800 (PST) Received: by 10.152.110.6 with SMTP id hw6mr13021776lab.37.1324666122143; Fri, 23 Dec 2011 10:48:42 -0800 (PST) MIME-Version: 1.0 Received: by 10.152.113.162 with HTTP; Fri, 23 Dec 2011 10:48:21 -0800 (PST) In-Reply-To: References: From: Todd Lipcon Date: Fri, 23 Dec 2011 10:48:21 -0800 Message-ID: Subject: Re: ceph and hbase. To: user@hbase.apache.org Cc: hbase-user@hadoop.apache.org Content-Type: text/plain; charset=KOI8-R Content-Transfer-Encoding: quoted-printable X-Virus-Checked: Checked by ClamAV on apache.org On Tue, Dec 20, 2011 at 12:56 AM, Andrey Stepachev wrote= : > I see, that most issues addressed to HA branch. > What version this branch is applied to? 0.22 or > i should build hadoop from sources? It's currently only available in the HDFS-1623 branch, which is in active development and definitely shouldn't be used unless you plan to help us finish debugging it :) There are still some known bugs and deficiencies to address before we merge. The plan is to merge it into 0.23 but not 0.22 - it will hopefully be merged in January. We'll also make it available in CDH4 beta releases early next year. -Todd > > 20 =C4=C5=CB=C1=C2=D2=D1 2011 =C7. 11:46 =D0=CF=CC=D8=DA=CF=D7=C1=D4=C5= =CC=D8 Todd Lipcon =CE=C1=D0=C9=D3=C1=CC: > >> Hi Andrey, >> >> I don't think anyone has ever run Ceph in a production use case, much >> less run it in a production use case with HBase. >> >> The SPOF problem is currently being addressed and will be available >> for production use by the middle of next calendar year. It will be >> available for preview/beta usage in Q1 (it's already working in >> development setups - feel free to follow HDFS-1623 for details) >> >> I think you're way better off waiting for the HA NameNode support in >> HDFS than going with an unproven FS like Ceph. Ceph certainly has >> promise and is a nice design, but it hasn't had the years of pounding >> that HDFS has. >> >> -Todd >> >> On Mon, Dec 19, 2011 at 10:23 PM, Andrey Stepachev >> wrote: >> > Hi all. >> > >> > I have requirements to use hbase in several datacenters. >> > But HDFS has as SPOF, so we can't use it. >> > I plan to use ceph as the file system for hbase. >> > >> > In general, interested in issues of: >> > a) use the hadoop + =D3eph in the production environment >> > b) using hbase + ceph in the production environment >> > >> > In particular: >> > Ceph Wiki states that the integration of hadoop/ceph has the problem i= n >> the >> > form of modification dates of the files. >> > Does hbase uses modification times for some critical tasks? >> > >> > -- >> > Andrey. >> >> >> >> -- >> Todd Lipcon >> Software Engineer, Cloudera >> > > > > -- > =E1=CE=C4=D2=C5=CA. --=20 Todd Lipcon Software Engineer, Cloudera