hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Billy" <sa...@pearsonwholesale.com>
Subject Re: Hbase for dynamic web site?
Date Fri, 30 Nov 2007 20:13:40 GMT
Whats the data size and queries per sec are you looking to put on hbase?

Memcache can take hugh load off mysql in most workloads. I use it and it has 
help a lot.

The reason we say this is hbase is still change and has not been released 
for production uses yet.


"Mike Perkowitz" <mike@trailfire.com> wrote in 
message news:006601c8338c$4f7736b0$8301a8c0@whogachuka...
> No, not right now. We need to use Hadoop/Hbase (or some alternative) for 
> the
> data processing anyway, so were wondering whether pulling directly from
> Hbase for the site pages would be feasible. We could certainly use 
> memcache
> for that aspect though.
> -----Original Message-----
> From: Ted Dunning [mailto:tdunning@veoh.com]
> Sent: Friday, November 30, 2007 9:50 AM
> To: hadoop-user@lucene.apache.org
> Subject: Re: Hbase for dynamic web site?
> Are you already using memcache and related approaches?
> On 11/30/07 9:46 AM, "Mike Perkowitz" 
> <mike@trailfire.com> wrote:
>> Hello! We have a web site currently built on linux/apache/mysql/php. Most
>> pages do some mysql queries and then stuff the results into php/html
>> templates. We've been hitting the limits of what our database can handle,
>> and what we can do in realtime for the site. Our plan is to move our data
>> over to Hbase, precomputing as much as we can (some queries we currently
> do
>> with joins in mysql, for example). Our pages would then be pulling rows
> from
>> Hbase to stuff into templates.
>> We're still working on getting Hbase working with the amount of data we
> want
>> to be able to handle, so haven't yet been able to test it for 
>> performance.
>> Is anyone else using Hbase in this way, and what has been your experience
>> with realtime performance? I haven't really seen examples of people using
>> Hbase this way - another approach would be for us to use
>> Hadoop/Hbase/mapreduce for computation then put results back into mysql 
>> or
>> whatever for realtime access. Any experience or suggestions would be
>> appreciated!
>> Thanks,
>> Mike

View raw message