hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Vladimir Rodionov <vladrodio...@gmail.com>
Subject Re: Multiwal performance with HBase 1.x
Date Fri, 18 Sep 2015 04:33:04 GMT
 Compaction is no longer a serious problem? Close to 850GB/h ingest rate
for 3 nodes cluster? Effect of 8 SSDs? Looks great, but ...

This is 78MB/sec load rate per server, taking into account compaction write
amplification looks unbelievable even for 8 SSD.

Can you publish test/hardware configuration and HBase version/config
options: Max Heap 64GB, how much was allocated to memstores? What was JVM
version/options? What GC did you use?

Thanks for results
-Vlad

On Thu, Sep 17, 2015 at 8:37 PM, Jingcheng Du <jingcheng.du@intel.com>
wrote:

> Now I've finished 3 tests for defaultWAL/singleWAL, 4 groups and 8 groups
> with 1TB data.
> Test env: 3 nodes, 8 SSD in each node, 64 GB heap size, pre-split 210
> regions in the cluster.
> Results:
> 1. DefaultWAL
> RunTime(ms), 5340650.0
> Throughput(ops/sec), 187243.12583674272
> AverageLatency(us), 1060.6468652781823
>
> 2. 4 groups
> RunTime(ms), 4326704.0
> Throughput(ops/sec), 231122.8131159423
> AverageLatency(us), 859.4096927494501
>
> 3. 8 groups
> RunTime(ms), 4222285.0
> Throughput(ops/sec), 236838.58384737174
> AverageLatency(us), 849.488522633065
>
>
>
>
>
>
>
> --
> View this message in context:
> http://apache-hbase.679495.n3.nabble.com/Multiwal-performance-with-HBase-1-x-tp4074403p4074727.html
> Sent from the HBase User mailing list archive at Nabble.com.
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message