hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Bryan Beaudreault <bbeaudrea...@hubspot.com>
Subject Re: What companies are using HBase to serve a customer-facing product?
Date Sun, 07 Dec 2014 06:14:42 GMT
At HubSpot we have 5 customer facing production clusters 30-60TB+ each. Our
Data Ops team has ranged from 2-3 (including me), but we support much more
than just hbase. We have an in-house built nightly backup system and
persist all HLogs on an ongoing basis, so in 2-3 hours we can recover to
within about a minute of any disaster . We are also looking at replication
for the future.

Our clusters serve mixed workloads, from APIs serving thousands of req/s to
Hadoop and other batch jobs. Each of these have different SLAs, but the
APIs are driving customer interactions so must be in the 100-500ms range or
lower, mostly.

On Saturday, December 6, 2014, lars hofhansl <larsh@apache.org> wrote:

> For expected latency, read this:
> http://hadoop-hbase.blogspot.com/2014/08/hbase-client-response-times.htmlFor
> cluster/machine sizing this might be helpful:
> http://hadoop-hbase.blogspot.com/2013/01/hbase-region-server-memory-sizing.html
>  Disclaimer: I wrote these two posts.
> -- Lars
>
>       From: jeremy p <athomewithagroovebox@gmail.com <javascript:;>>
>  To: user@hbase.apache.org <javascript:;>
>  Sent: Friday, December 5, 2014 1:37 PM
>  Subject: What companies are using HBase to serve a customer-facing
> product?
>
> Hey all,
>
> So, I'm currently evaluating HBase as a solution for querying a very large
> data set (think 60+ TB). We'd like to use it to directly power a
> customer-facing product. My question is threefold :
>
> 1) What companies use HBase to serve a customer-facing product? I'm not
> interested in evaluations, experiments, or POC.  I'm also not interested in
> offline BI or analytics.  I'm specifically interested in cases where HBase
> serves as the data store for a customer-facing product.
>
> 2) Of the companies that use HBase to serve a customer-facing product,
> which ones use it to query data sets of 60TB or more?
>
> 3) Of companies use HBase to query 60+ TB data sets and serve a
> customer-facing product, how many employees are required to support their
> HBase installation?  In other words, if I were to start a team tomorrow,
> and their purpose was to maintain a 60+ TB HBase installation for a
> customer-facing product, how many people should I hire?
>
> 4) Of companies use HBase to query 60+ TB data sets and serve a
> customer-facing product, what kind of measures do they take for disaster
> recovery?
>
> If you can, please point me to articles, videos, and other materials.
> Obviously, the larger the company, the better case it will make for HBase.
>
> Thank you!
>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message