hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Purtell (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HBASE-11297) Remove some synchros in the rpcServer responder
Date Tue, 24 Jun 2014 02:17:26 GMT

    [ https://issues.apache.org/jira/browse/HBASE-11297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14041607#comment-14041607
] 

Andrew Purtell edited comment on HBASE-11297 at 6/24/14 2:16 AM:
-----------------------------------------------------------------

I measure a small trade of latency for throughput on most workloads. I piggybacked this on
something else so the test was run on 8u20 b17 . I would expect very similar results with
7u60.
\\
\\
||Workload A||0.98.4-SNAPSHOT||0.98.4-SNAPSHOT+11297||
|OVERALL RunTime(ms)|100996|100738|
|OVERALL Throughput(ops/sec)|99013|99267|
|READ Operations|4999690|5000163|
|READ AverageLatency(us)|651.6789|651.97|
|READ MinLatency(us)|255|260|
|READ MaxLatency(us)|655882|651083|
|READ 95thPercentileLatency(ms)|0|0|
|READ 99thPercentileLatency(ms)	|4|5|
|UPDATE Operations|5000470|4999996|
|UPDATE AverageLatency(us)|32.80|27.25|
|UPDATE MinLatency(us)|0|0|
|UPDATE MaxLatency(us)|652182|687377|
|UPDATE 95thPercentileLatency(ms)|0|0|
|UPDATE 99thPercentileLatency(ms)|0|0|
\\
||Workload B||0.98.4-SNAPSHOT||0.98.4-SNAPSHOT+11297||
|OVERALL RunTime(ms)|100536|100480|
|OVERALL Throughput(ops/sec)|99466|99521|
|READ Operations|9499944|9499498|
|READ AverageLatency(us)|599.54|653.32|
|READ MinLatency(us)|259|271|
|READ MaxLatency(us)|710357|727001|
|READ 95thPercentileLatency(ms)|0|1|
|READ 99thPercentileLatency(ms)|3|4|
|UPDATE Operations|500216|500661|
|UPDATE AverageLatency(us)|119.18|145.18|
|UPDATE MinLatency(us)|0|0|
|UPDATE MaxLatency(us)|664203|666895|
|UPDATE 95thPercentileLatency(ms)|0|0|
|UPDATE 99thPercentileLatency(ms)|0|0|
\\
||Workload C||0.98.4-SNAPSHOT||0.98.4-SNAPSHOT+11297||
|OVERALL RunTime(ms)|100021|100021|
|OVERALL Throughput(ops/sec)|99979|99979|
|READ Operations|1000000|1000000|
|READ AverageLatency(us)|543.22|550.31|
|READ MinLatency(us)|256|259|
|READ MaxLatency(us)|735497|721836|
|READ 95thPercentileLatency(ms)|0|0|
|READ 99thPercentileLatency(ms)|4|4|
\\
||Workload D||0.98.4-SNAPSHOT||0.98.4-SNAPSHOT+11297||
|OVERALL RunTime(ms)|103916|103250|
|OVERALL Throughput(ops/sec)|96237|96854|
|READ Operations|9500043|9499220|
|READ AverageLatency(us)|662.044|674.25|
|READ MinLatency(us)|262|261|
|READ MaxLatency(us)|1054555|742158|
|READ 95thPercentileLatency(ms)|1|0|
|READ 99thPercentileLatency(ms)|4|5|
|INSERT Operations|4999567|500780|
|INSERT AverageLatency(us)|14.38|15.61|
|INSERT MinLatency(us)|4|4|
|INSERT MaxLatency(us)|492058|482944|
|INSERT 95thPercentileLatency(ms)|0|0|
|INSERT 99thPercentileLatency(ms)|0|0|
\\
||Workload E||0.98.4-SNAPSHOT||0.98.4-SNAPSHOT+11297||
|OVERALL RunTime(ms)|1302270|1309841|
|OVERALL Throughput(ops/sec)|7823|7777|
|INSERT Operations|499441|499751|
|INSERT AverageLatency(us)|18.06|15.86|
|INSERT MinLatency(us)|5|5|
|INSERT MaxLatency(us)|544490|576905|
|INSERT 95thPercentileLatency(ms)|0|0|
|INSERT 99thPercentileLatency(ms)|0|0|
|SCAN Operations|9500559|9500248|
|SCAN AverageLatency(us)|21637.25|21770.74|
|SCAN MinLatency(us)|750|770|
|SCAN MaxLatency(us)|3134120|3399749|
|SCAN 95thPercentileLatency(ms)|124|123|
|SCAN 99thPercentileLatency(ms)|171|174|
\\
||Workload F||0.98.4-SNAPSHOT||0.98.4-SNAPSHOT+11297||
|OVERALL RunTime(ms)|95554|94002|
|OVERALL Throughput(ops/sec)|92446|92670|
|READ Operations|9333650|9333350|
|READ AverageLatency(us)|701.67|716.06|
|READ MinLatency(us)|264|272|
|READ MaxLatency(us)|773925|745086|
|READ 95thPercentileLatency(ms)|1|1|
|READ 99thPercentileLatency(ms)|8|7|
|READ-MODIFY-WRITE Operations|4666526|4667535|
|READ-MODIFY-WRITE AverageLatency(us)|706.91|719.93|
|READ-MODIFY-WRITE MinLatency(us)|268|276|
|READ-MODIFY-WRITE MaxLatency(us)|773996|738262|
|READ-MODIFY-WRITE 95thPercentileLatency(ms)|1|1|
|READ-MODIFY-WRITE 99thPercentileLatency(ms)|8|7|
|UPDATE Operations|4666675|4667684|
|UPDATE AverageLatency(us)|23.40|17.86|
|UPDATE MinLatency(us)|0|1|
|UPDATE MaxLatency(us)|1264590|1261227|
|UPDATE 95thPercentileLatency(ms)|0|0|
|UPDATE 99thPercentileLatency(ms)|0|0|


was (Author: apurtell):
I measure a small trade of throughput for latency on most workloads. I piggybacked this on
something else so the test was run on 8u20 b17 . I would expect very similar results with
7u60.
\\
\\
||Workload A||0.98.4-SNAPSHOT||0.98.4-SNAPSHOT+11297||
|OVERALL RunTime(ms)|100996|100738|
|OVERALL Throughput(ops/sec)|99013|99267|
|READ Operations|4999690|5000163|
|READ AverageLatency(us)|651.6789|651.97|
|READ MinLatency(us)|255|260|
|READ MaxLatency(us)|655882|651083|
|READ 95thPercentileLatency(ms)|0|0|
|READ 99thPercentileLatency(ms)	|4|5|
|UPDATE Operations|5000470|4999996|
|UPDATE AverageLatency(us)|32.80|27.25|
|UPDATE MinLatency(us)|0|0|
|UPDATE MaxLatency(us)|652182|687377|
|UPDATE 95thPercentileLatency(ms)|0|0|
|UPDATE 99thPercentileLatency(ms)|0|0|
\\
||Workload B||0.98.4-SNAPSHOT||0.98.4-SNAPSHOT+11297||
|OVERALL RunTime(ms)|100536|100480|
|OVERALL Throughput(ops/sec)|99466|99521|
|READ Operations|9499944|9499498|
|READ AverageLatency(us)|599.54|653.32|
|READ MinLatency(us)|259|271|
|READ MaxLatency(us)|710357|727001|
|READ 95thPercentileLatency(ms)|0|1|
|READ 99thPercentileLatency(ms)|3|4|
|UPDATE Operations|500216|500661|
|UPDATE AverageLatency(us)|119.18|145.18|
|UPDATE MinLatency(us)|0|0|
|UPDATE MaxLatency(us)|664203|666895|
|UPDATE 95thPercentileLatency(ms)|0|0|
|UPDATE 99thPercentileLatency(ms)|0|0|
\\
||Workload C||0.98.4-SNAPSHOT||0.98.4-SNAPSHOT+11297||
|OVERALL RunTime(ms)|100021|100021|
|OVERALL Throughput(ops/sec)|99979|99979|
|READ Operations|1000000|1000000|
|READ AverageLatency(us)|543.22|550.31|
|READ MinLatency(us)|256|259|
|READ MaxLatency(us)|735497|721836|
|READ 95thPercentileLatency(ms)|0|0|
|READ 99thPercentileLatency(ms)|4|4|
\\
||Workload D||0.98.4-SNAPSHOT||0.98.4-SNAPSHOT+11297||
|OVERALL RunTime(ms)|103916|103250|
|OVERALL Throughput(ops/sec)|96237|96854|
|READ Operations|9500043|9499220|
|READ AverageLatency(us)|662.044|674.25|
|READ MinLatency(us)|262|261|
|READ MaxLatency(us)|1054555|742158|
|READ 95thPercentileLatency(ms)|1|0|
|READ 99thPercentileLatency(ms)|4|5|
|INSERT Operations|4999567|500780|
|INSERT AverageLatency(us)|14.38|15.61|
|INSERT MinLatency(us)|4|4|
|INSERT MaxLatency(us)|492058|482944|
|INSERT 95thPercentileLatency(ms)|0|0|
|INSERT 99thPercentileLatency(ms)|0|0|
\\
||Workload E||0.98.4-SNAPSHOT||0.98.4-SNAPSHOT+11297||
|OVERALL RunTime(ms)|1302270|1309841|
|OVERALL Throughput(ops/sec)|7823|7777|
|INSERT Operations|499441|499751|
|INSERT AverageLatency(us)|18.06|15.86|
|INSERT MinLatency(us)|5|5|
|INSERT MaxLatency(us)|544490|576905|
|INSERT 95thPercentileLatency(ms)|0|0|
|INSERT 99thPercentileLatency(ms)|0|0|
|SCAN Operations|9500559|9500248|
|SCAN AverageLatency(us)|21637.25|21770.74|
|SCAN MinLatency(us)|750|770|
|SCAN MaxLatency(us)|3134120|3399749|
|SCAN 95thPercentileLatency(ms)|124|123|
|SCAN 99thPercentileLatency(ms)|171|174|
\\
||Workload F||0.98.4-SNAPSHOT||0.98.4-SNAPSHOT+11297||
|OVERALL RunTime(ms)|95554|94002|
|OVERALL Throughput(ops/sec)|92446|92670|
|READ Operations|9333650|9333350|
|READ AverageLatency(us)|701.67|716.06|
|READ MinLatency(us)|264|272|
|READ MaxLatency(us)|773925|745086|
|READ 95thPercentileLatency(ms)|1|1|
|READ 99thPercentileLatency(ms)|8|7|
|READ-MODIFY-WRITE Operations|4666526|4667535|
|READ-MODIFY-WRITE AverageLatency(us)|706.91|719.93|
|READ-MODIFY-WRITE MinLatency(us)|268|276|
|READ-MODIFY-WRITE MaxLatency(us)|773996|738262|
|READ-MODIFY-WRITE 95thPercentileLatency(ms)|1|1|
|READ-MODIFY-WRITE 99thPercentileLatency(ms)|8|7|
|UPDATE Operations|4666675|4667684|
|UPDATE AverageLatency(us)|23.40|17.86|
|UPDATE MinLatency(us)|0|1|
|UPDATE MaxLatency(us)|1264590|1261227|
|UPDATE 95thPercentileLatency(ms)|0|0|
|UPDATE 99thPercentileLatency(ms)|0|0|

> Remove some synchros in the rpcServer responder
> -----------------------------------------------
>
>                 Key: HBASE-11297
>                 URL: https://issues.apache.org/jira/browse/HBASE-11297
>             Project: HBase
>          Issue Type: Bug
>          Components: regionserver
>    Affects Versions: 0.99.0
>            Reporter: Nicolas Liochon
>            Assignee: Nicolas Liochon
>             Fix For: 0.99.0
>
>         Attachments: 11297.v1.patch, 11297.v2.patch, 11297.v2.v98.patch, 11297.v3.patch
>
>
> This is on top of another patch that I'm going to put into another jira.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message