hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Pradeep Gollakota <pradeep...@gmail.com>
Subject Re: What companies are using HBase to serve a customer-facing product?
Date Sun, 07 Dec 2014 06:22:12 GMT
Lithium (Klout) powers www.klout.com with HBase. The operations team is 2
full time engineers + the manager (who also does hands on operations work
with the team). This operations team is responsible for the entirety of our
Hadoop stack including the HBase clusters. We have one 165 node Hive
cluster for Data Science and 5 HBase clusters (of varying sizes), 2 of
which are used to power klout.com.

We have strong SLA requirements for klout.com as it is a user facing
product. I don't remember the sizing of our HBase clusters off hand but
they are substantial enough to load user profile data and Klout scores for
approximately 600 million users on a daily basis. I believe the data set is
in the order of several terabytes.

On Sat Dec 06 2014 at 8:49:37 PM lars hofhansl <larsh@apache.org> wrote:

> For expected latency, read this: http://hadoop-hbase.blogspot.
> com/2014/08/hbase-client-response-times.htmlFor cluster/machine sizing
> this might be helpful: http://hadoop-hbase.blogspot.
> com/2013/01/hbase-region-server-memory-sizing.html  Disclaimer: I wrote
> these two posts.
> -- Lars
>
>       From: jeremy p <athomewithagroovebox@gmail.com>
>  To: user@hbase.apache.org
>  Sent: Friday, December 5, 2014 1:37 PM
>  Subject: What companies are using HBase to serve a customer-facing
> product?
>
> Hey all,
>
> So, I'm currently evaluating HBase as a solution for querying a very large
> data set (think 60+ TB). We'd like to use it to directly power a
> customer-facing product. My question is threefold :
>
> 1) What companies use HBase to serve a customer-facing product? I'm not
> interested in evaluations, experiments, or POC.  I'm also not interested in
> offline BI or analytics.  I'm specifically interested in cases where HBase
> serves as the data store for a customer-facing product.
>
> 2) Of the companies that use HBase to serve a customer-facing product,
> which ones use it to query data sets of 60TB or more?
>
> 3) Of companies use HBase to query 60+ TB data sets and serve a
> customer-facing product, how many employees are required to support their
> HBase installation?  In other words, if I were to start a team tomorrow,
> and their purpose was to maintain a 60+ TB HBase installation for a
> customer-facing product, how many people should I hire?
>
> 4) Of companies use HBase to query 60+ TB data sets and serve a
> customer-facing product, what kind of measures do they take for disaster
> recovery?
>
> If you can, please point me to articles, videos, and other materials.
> Obviously, the larger the company, the better case it will make for HBase.
>
> Thank you!
>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message