hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From zhiyuan yang <sjtu....@gmail.com>
Subject Re: Random read operation about hundreds request per second
Date Fri, 07 Nov 2014 21:56:17 GMT
I used hbase 0.94.18, hadoop 2.4.0 on AWS EMR m1.large with all default
heap size.

On Thu, Nov 6, 2014 at 10:11 PM, Ted Yu <yuzhihong@gmail.com> wrote:

> Can you provide a bit more information about your environment ?
>
> hbase release
> hadoop release
> hardware config
> heap size for the daemons
>
> Cheers
>
> On Thu, Nov 6, 2014 at 5:24 PM, zhiyuan yang <sjtu.yzy@gmail.com> wrote:
>
> > Hi,
> >
> > I'm new to hbase. Several days ago I built an web service with hbase as
> > backend.
> > However, when I used ab benchmark to test the performance of read only
> > wordload,
> > the result was only hundreds request per second even hbase cache hit
> ration
> > was 100%.
> >
> > The architecture of my system is as following. I use netty as web
> framework
> > and use
> > thrift to connect hbase. Netty handler uses connection pool to get the
> > thrift connection,
> > and send simple get query. Hbase is deployed on 1 master and 1 slave. The
> > thrift server
> > is opened on HMaster.
> >
> > I'm sure the problem doesn't lie in pooling, because if I just get
> > connection without
> > really using it in handler, and the result rps is several thousands. But
> I
> > don't know where
> > the bottleneck is exactly.
> >
> > Can anyone help me out? Really appreciate your help.
> >
> > --
> >
> > *Thank you && Best Regards,*
> >
> > *Zhiyuan Yang*
> >
>



-- 

*Thank you && Best Regards,*

*Zhiyuan Yang*

---------------------------------------------------------------------

Master of Computational Data Science

School of Computer Science

Carnegie Mellon University

5000 Forbes Ave, Pittsburgh, PA, 15213

Phone: (+1) 412-708-3527

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message