Return-Path: Delivered-To: apmail-hadoop-hbase-user-archive@locus.apache.org Received: (qmail 38861 invoked from network); 25 Nov 2008 19:09:00 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 25 Nov 2008 19:09:00 -0000 Received: (qmail 49931 invoked by uid 500); 25 Nov 2008 19:09:11 -0000 Delivered-To: apmail-hadoop-hbase-user-archive@hadoop.apache.org Received: (qmail 49579 invoked by uid 500); 25 Nov 2008 19:09:10 -0000 Mailing-List: contact hbase-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hbase-user@hadoop.apache.org Delivered-To: mailing list hbase-user@hadoop.apache.org Received: (qmail 49568 invoked by uid 99); 25 Nov 2008 19:09:10 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 25 Nov 2008 11:09:10 -0800 X-ASF-Spam-Status: No, hits=3.4 required=10.0 tests=HTML_MESSAGE,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (athena.apache.org: local policy) Received: from [74.125.46.30] (HELO yw-out-2324.google.com) (74.125.46.30) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 25 Nov 2008 19:07:43 +0000 Received: by yw-out-2324.google.com with SMTP id 9so67460ywe.29 for ; Tue, 25 Nov 2008 11:08:18 -0800 (PST) Received: by 10.100.240.17 with SMTP id n17mr2488909anh.138.1227640098525; Tue, 25 Nov 2008 11:08:18 -0800 (PST) Received: by 10.100.251.15 with HTTP; Tue, 25 Nov 2008 11:08:18 -0800 (PST) Message-ID: Date: Tue, 25 Nov 2008 19:08:18 +0000 From: "Seref Arikan" To: hbase-user@hadoop.apache.org Subject: Re: Advice request about real time use of hbase In-Reply-To: <492C4535.7080208@duboce.net> MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_Part_6379_15859929.1227640098515" References: <492C4535.7080208@duboce.net> X-Virus-Checked: Checked by ClamAV on apache.org ------=_Part_6379_15859929.1227640098515 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline Hi, Thanks for the feedback. I am in the early phases of my evaluation of technologies for the task. It is a proof of concept project, sorry about being cryptic, but NDAs are NDAs. My functional requirements are not clear at the moment, so it is hard to define acceptable performance. But a rdbms cached setup would be interesting. Any pointers to such a setup? Even parallel but different scenarios would be helpful. Papers, urls to articles etc? Kind regards Seref On Tue, Nov 25, 2008 at 6:34 PM, stack wrote: > Seref Arikan wrote: > >> I am very keen to work on hbase and hadoop, but especially for the case of >> hbase, the material I've found so far does not look promising for using it >> as backend of an information system. >> > ... > >> The question is: are there any practices, recommended methods etc for >> implementing a hbase based backend for an information system like a web >> based app or a medium sized enterprise application with a couple of >> hundred >> users? >> >> > ... > >> The original bigfile paper by Google gives names of some google >> application >> which are very responsive and obviously require real time query/insert >> etc. >> Any ideas, suggestions would be appreciated a lot. Hybrid approaches with >> rdbms etc? >> > > Yes. Our random-access performance up to this has been lacking. Fellas > are using hbase to serve out of in real-time but they'll usually have a > cache in front of hbase, in the same way as folks will run a memcached in > front of their SQL db as noted in the streamy.com paragraph up on the > powered-by page (Also see the pigi project listed in the supporting projects > page). > > Up to this we've been focused on reliability and scaling. After our 0.19.0 > release goes out, we're going to turn our focus to efficiency and > performance (though 0.19.0 promises big performance increases -- we'll post > more on this around hbase 0.19.0 release time). > > If you want to join us for the ride, we'd love to have you. What kind of > numbers do you need in order for you to commit to hbase? > > If you want to set up a test cluster to do your own measurements, let us > know how we can help. > > St.Ack > ------=_Part_6379_15859929.1227640098515--