hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Antonio Alvarado Hernández <aalvara...@gmail.com>
Subject Re: The hfile.block.cache.size = 0 performance is better than default(0.2) in random read? Is it possible?
Date Thu, 21 Oct 2010 04:48:29 GMT
Hi all,
Could be related with a low hit ratio?
-aah

2010/10/21, Tao Xie <xietao.mailbox@gmail.com>:
> BTW, Ryan, can you share some configurations tips of running YCSB to get
> better random read performance?
> Or can you provide some YCSB test results? In my experiments, I get 40~50k/s
> insert throughput but only ~2k/s read throughput.
> I wonder if there is something wrong with my configuration.
>
> Thanks in advance.
>
> 2010/10/21 Ryan Rawson <ryanobjc@gmail.com>
>
>> Our own systems show much better performance with more cache, not sure
>> why your test is weird.  Maybe you could try to reproduce your results
>> under YCSB, then we might have a chance of running your benchmark.
>>
>>
>> On Wed, Oct 20, 2010 at 8:19 PM, ChingShen <chingshenchen@gmail.com>
>> wrote:
>> > Hi all,
>> >
>> >  I run my performance testing in random read, but I got the
>> > hfile.block.cache.size = 0 performance is better than default, Is it
>> > possible?
>> >
>> >  My cluster (4 nodes):
>> >  Hadoop 0.20.2, HBase 0.20.6
>> >  1 * namenode & hmaster & zookeeper
>> >  3 * datanode & regionserver
>> >
>> >  P.S. Replication factor = 3, HBase heap size is 3500mb
>> >
>> > There are 10 millions records in my testing table, and per record
>> > approximately 1kb.
>> >
>> > * The hfile.block.cache.size = 0*:
>> > ==============================================
>> > java benchmark.HReadR *10000* 1
>> > initial cost: 297 ms.
>> > read: 198358 ms
>> > read per: 19.8358 ms
>> > *read thput: 50.4139 ops/sec*
>> > ==============================================
>> > java benchmark.HReadR *100000* 1
>> > initial cost: 285 ms.
>> > read: 772474 ms
>> > read per: 7.72474 ms
>> > *read thput: 129.4542 ops/sec*
>> > ==============================================
>> > java benchmark.HReadR *10000* 1
>> > initial cost: 291 ms.
>> > read: 43939 ms
>> > read per: 4.3939 ms
>> > *read thput: 227.58826 ops/sec*
>> > ==============================================
>> > java benchmark.HReadR *100000* 1
>> > initial cost: 292 ms.
>> > read: 296763 ms
>> > read per: 2.96763 ms
>> > *read thput: 336.96924 ops/sec*
>> > ==============================================
>> >
>> >
>> > * The hfile.block.cache.size = 0.2 (default)*:
>> > ==============================================
>> > java benchmark.HReadR *10000* 1
>> > initial cost: 282 ms.
>> > read: 157538 ms
>> > read per: 15.7538 ms
>> > read thput: *63.47675* ops/sec
>> > ==============================================
>> > java benchmark.HReadR *100000* 1
>> > initial cost: 292 ms.
>> > read: 983083 ms
>> > read per: 9.83083 ms
>> > read thput: *101.72081* ops/sec
>> > ==============================================
>> > java benchmark.HReadR *10000* 1
>> > initial cost: 286 ms.
>> > read: 83260 ms
>> > read per: 8.326 ms
>> > read thput: *120.10569* ops/sec
>> > ==============================================
>> > java benchmark.HReadR *100000* 1
>> > initial cost: 288 ms.
>> > read: 839874 ms
>> > read per: 8.39874 ms
>> > read thput: *119.065475* ops/sec
>> > ==============================================
>> >
>> >
>> > Shen
>> >
>>
>

-- 
Enviado desde mi dispositivo móvil

Mime
View raw message