Return-Path: Delivered-To: apmail-hadoop-hbase-dev-archive@locus.apache.org Received: (qmail 26262 invoked from network); 1 Apr 2008 03:46:21 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 1 Apr 2008 03:46:21 -0000 Received: (qmail 18440 invoked by uid 500); 1 Apr 2008 03:46:21 -0000 Delivered-To: apmail-hadoop-hbase-dev-archive@hadoop.apache.org Received: (qmail 18418 invoked by uid 500); 1 Apr 2008 03:46:21 -0000 Mailing-List: contact hbase-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hbase-dev@hadoop.apache.org Delivered-To: mailing list hbase-dev@hadoop.apache.org Received: (qmail 18408 invoked by uid 99); 1 Apr 2008 03:46:21 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 31 Mar 2008 20:46:21 -0700 X-ASF-Spam-Status: No, hits=-0.0 required=10.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: local policy) Received: from [63.203.238.117] (HELO dns.duboce.net) (63.203.238.117) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 01 Apr 2008 03:45:40 +0000 Received: by dns.duboce.net (Postfix, from userid 1008) id DDA90C563; Mon, 31 Mar 2008 19:18:30 -0700 (PDT) X-Spam-Checker-Version: SpamAssassin 3.1.4 (2006-07-26) on dns.duboce.net X-Spam-Level: Received: from durruti.local (unknown [192.168.1.135]) by dns.duboce.net (Postfix) with ESMTP id 03770C51B for ; Mon, 31 Mar 2008 19:18:28 -0700 (PDT) Message-ID: <47F1AF22.5080208@duboce.net> Date: Mon, 31 Mar 2008 20:42:26 -0700 From: stack User-Agent: Thunderbird 2.0.0.12 (Macintosh/20080213) MIME-Version: 1.0 To: hbase-dev@hadoop.apache.org Subject: Re: Serving from memory References: In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org X-Old-Spam-Status: No, score=-4.4 required=5.0 tests=ALL_TRUSTED,BAYES_00 autolearn=ham version=3.1.4 A Reference-cache of hot cells would take a day at the outside I'd guess. The bulk of the work is done. If you're talking about something else, lets discuss. What would it look like? Store MapFiles would be floated in memory or copied to MemCache? We'd need a special In-Memory MapFile? We'd do a bulk memcopy from HDFS up into mem and then you'd serve from there? Would the table have to be read-only? St.Ack Bryan Duxbury wrote: > Quick poll for us devs - if you had to guess, how long do you think it > would take for the in-memory option of HBase to actually be > implemented to work reliably? > > -Bryan