hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harold Lim <rold...@yahoo.com>
Subject Re: How to improve HBase throughput with YCSB?
Date Tue, 31 May 2011 05:08:15 GMT
Hi Ted,

I haven't tried with bigger instances yet. Those are my next steps.

I also see that you have a forked version of YCSB, will that make my performance better?


Thanks,
Harold





--- On Tue, 5/31/11, Ted Dunning <tdunning@maprtech.com> wrote:

> From: Ted Dunning <tdunning@maprtech.com>
> Subject: Re: How to improve HBase throughput with YCSB?
> To: user@hbase.apache.org
> Date: Tuesday, May 31, 2011, 12:38 AM
> What happens if you increase heap
> space to 8GB on an m1.xlarge or
> m2.2xlarge?
> 
> 
> On Mon, May 30, 2011 at 8:50 PM, Harold Lim <rold_50@yahoo.com>
> wrote:
> 
> > Hi Lohit,
> >
> > I'm running HBase 0.90.2. 10 x ec2 m1.large instances.
> I set the heap size
> > to 4GB and handler count for hbase, and dfs to 100. I
> also set the dfs max
> > xcievers to 4096
> >
> > I'm running a pure random read YCSB workload.
> >
> > I also tried running multiple clients from multiple
> ec2 instances, but that
> > just degrades the throughput of each client. I also
> tried increasing the
> > number of threads and it doesn't seem to help.
> >
> > Below is the output I get from YCSB:
> >
> > YCSB Client 0.1
> > Command line: -t -db com.yahoo.ycsb.db.HBaseClient -P
> > workloads/workloadstar-100_0 -p columnfamily=data -p
> operationcount=120000
> > -s -threads 50 -target 600
> > [OVERALL], RunTime(ms), 246398.0
> > [OVERALL], Throughput(ops/sec), 487.01694007256555
> > [READ], Operations, 120000
> > [READ], AverageLatency(ms), 70.07661666666667
> > [READ], MinLatency(ms), 0
> > [READ], MaxLatency(ms), 2779
> > [READ], 95thPercentileLatency(ms), 393
> > [READ], 99thPercentileLatency(ms), 855
> > [READ], Return=0, 120000
> >
> > Thanks,
> > Harold
> >
> >
> > --- On Mon, 5/30/11, lohit <lohit.vijayarenu@gmail.com>
> wrote:
> >
> > > From: lohit <lohit.vijayarenu@gmail.com>
> > > Subject: Re: How to improve HBase throughput with
> YCSB?
> > > To: user@hbase.apache.org
> > > Date: Monday, May 30, 2011, 3:38 PM
> > > Hello Harold,
> > >
> > > Can you share with us what kind of throughput you
> are
> > > seeing.
> > > Number of ops/sec and read latency you are
> seeing.
> > > Also, what version of hbase are you running.
> > >
> > > Thanks,
> > > Lohit
> > >
> > > 2011/5/30 Harold Lim <rold_50@yahoo.com>
> > >
> > > > Hi All,
> > > >
> > > > I have an HBase cluster on ec2 m1.large
> instance (10
> > > region servers). I'm
> > > > trying to run a read-only YCSB workload. It
> seems that
> > > I can't get a good
> > > > throughput. It saturates to around 600+
> operations per
> > > second.
> > > >
> > > > My dataset is around 200GB (~1k+ regions).
> Running
> > > major compaction and
> > > > also setting the handler count to 100 helped
> improve
> > > the performance a
> > > > little bit.
> > > >
> > > > Are there setting or configurations that I
> need to
> > > set?
> > > >
> > > > Thanks,
> > > > Harold
> > > >
> > > >
> > >
> > >
> > > --
> > > Have a Nice Day!
> > > Lohit
> > >
> >
> 

Mime
View raw message