hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Dunning <tdunn...@maprtech.com>
Subject Re: How to improve HBase throughput with YCSB?
Date Tue, 31 May 2011 04:38:15 GMT
What happens if you increase heap space to 8GB on an m1.xlarge or
m2.2xlarge?


On Mon, May 30, 2011 at 8:50 PM, Harold Lim <rold_50@yahoo.com> wrote:

> Hi Lohit,
>
> I'm running HBase 0.90.2. 10 x ec2 m1.large instances. I set the heap size
> to 4GB and handler count for hbase, and dfs to 100. I also set the dfs max
> xcievers to 4096
>
> I'm running a pure random read YCSB workload.
>
> I also tried running multiple clients from multiple ec2 instances, but that
> just degrades the throughput of each client. I also tried increasing the
> number of threads and it doesn't seem to help.
>
> Below is the output I get from YCSB:
>
> YCSB Client 0.1
> Command line: -t -db com.yahoo.ycsb.db.HBaseClient -P
> workloads/workloadstar-100_0 -p columnfamily=data -p operationcount=120000
> -s -threads 50 -target 600
> [OVERALL], RunTime(ms), 246398.0
> [OVERALL], Throughput(ops/sec), 487.01694007256555
> [READ], Operations, 120000
> [READ], AverageLatency(ms), 70.07661666666667
> [READ], MinLatency(ms), 0
> [READ], MaxLatency(ms), 2779
> [READ], 95thPercentileLatency(ms), 393
> [READ], 99thPercentileLatency(ms), 855
> [READ], Return=0, 120000
>
> Thanks,
> Harold
>
>
> --- On Mon, 5/30/11, lohit <lohit.vijayarenu@gmail.com> wrote:
>
> > From: lohit <lohit.vijayarenu@gmail.com>
> > Subject: Re: How to improve HBase throughput with YCSB?
> > To: user@hbase.apache.org
> > Date: Monday, May 30, 2011, 3:38 PM
> > Hello Harold,
> >
> > Can you share with us what kind of throughput you are
> > seeing.
> > Number of ops/sec and read latency you are seeing.
> > Also, what version of hbase are you running.
> >
> > Thanks,
> > Lohit
> >
> > 2011/5/30 Harold Lim <rold_50@yahoo.com>
> >
> > > Hi All,
> > >
> > > I have an HBase cluster on ec2 m1.large instance (10
> > region servers). I'm
> > > trying to run a read-only YCSB workload. It seems that
> > I can't get a good
> > > throughput. It saturates to around 600+ operations per
> > second.
> > >
> > > My dataset is around 200GB (~1k+ regions). Running
> > major compaction and
> > > also setting the handler count to 100 helped improve
> > the performance a
> > > little bit.
> > >
> > > Are there setting or configurations that I need to
> > set?
> > >
> > > Thanks,
> > > Harold
> > >
> > >
> >
> >
> > --
> > Have a Nice Day!
> > Lohit
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message