Return-Path: X-Original-To: apmail-hbase-dev-archive@www.apache.org Delivered-To: apmail-hbase-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id DB4298B09 for ; Mon, 5 Sep 2011 21:17:16 +0000 (UTC) Received: (qmail 15957 invoked by uid 500); 5 Sep 2011 21:17:16 -0000 Delivered-To: apmail-hbase-dev-archive@hbase.apache.org Received: (qmail 15847 invoked by uid 500); 5 Sep 2011 21:17:15 -0000 Mailing-List: contact dev-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hbase.apache.org Delivered-To: mailing list dev@hbase.apache.org Received: (qmail 15838 invoked by uid 99); 5 Sep 2011 21:17:15 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 05 Sep 2011 21:17:15 +0000 X-ASF-Spam-Status: No, hits=2.7 required=5.0 tests=RCVD_IN_PSBL,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of bill@dehora.net designates 207.7.108.242 as permitted sender) Received: from [207.7.108.242] (HELO chilco.textdrive.com) (207.7.108.242) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 05 Sep 2011 21:17:08 +0000 Received: from [192.168.1.59] (unknown [79.97.15.193]) by chilco.textdrive.com (Postfix) with ESMTP id 456023964 for ; Mon, 5 Sep 2011 21:06:33 +0000 (UTC) Message-ID: <4E6539D6.9040008@dehora.net> Date: Mon, 05 Sep 2011 22:06:30 +0100 From: Bill User-Agent: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.2.21) Gecko/20110831 Thunderbird/3.1.13 MIME-Version: 1.0 To: dev@hbase.apache.org Subject: Re: [DISCUSSION] Accumulo, another BigTable clone, has shown up on Apache Incubator as a proposal References: <4E62B56A.2000301@dehora.net> In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Virus-Checked: Checked by ClamAV on apache.org On 04/09/11 07:43, Mathias Herberts wrote: > On Sep 4, 2011 1:39 AM, "Bill de hÓra" wrote: >> >> On 02/09/11 19:06, Stack wrote: >>> >>> What do folks think? >> >> >> Not putting the log into hdfs seems like a good idea. > > I was somehow thinking the opposite as it makes irrecoverable machine > failures much more problematic. What makes you say it's a good idea? > Allows more control over the write path, specifically sequential I/O and crash recovery. Granted the commit needs to be replicated, but you need that regardless. Thinking a bit more it might not square with the regionserver model anyway, plus the Accumulo proposal mentions a service rather than a local disk. The WAL seems to be hardened up these days anyway making things like https://issues.apache.org/jira/browse/HBASE-4107 more of an edge case.. Bill