hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "stack (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-15536) Make AsyncFSWAL as our default WAL
Date Wed, 30 Mar 2016 20:45:26 GMT

    [ https://issues.apache.org/jira/browse/HBASE-15536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15218822#comment-15218822
] 

stack commented on HBASE-15536:
-------------------------------

I did a rough compare where I ran ycsb load against a single server instance running over
an HDFS. Numbers were hbase 2.0 tip with asyncwal disabled/enabled:

{code}
18096 2016-03-30 13:07:21:600 4330 sec: 61688560 operations; 14370.85 current ops/sec; est
completion in 7 hours 10 minutes [INSERT: Count=143767, Max=201727, Min=916, Avg=3465.51,
90=4615, 99=13639, 99.9=78207, 99.99=200703]
18097 2016-03-30 13:07:31:596 4340 sec: 61833035 operations; 14453.28 current ops/sec; est
completion in 7 hours 10 minutes [INSERT: Count=144469, Max=267007, Min=923, Avg=3463.2, 90=4603,
99=6875, 99.9=152319, 99.99=264959]
18098 2016-03-30 13:07:41:596 4350 sec: 61995299 operations; 16226.4 current ops/sec; est
completion in 7 hours 9 minutes [INSERT: Count=162271, Max=64063, Min=850, Avg=3076.64, 90=4535,
99=6427, 99.9=45983, 99.99=62719]
18099 2016-03-30 13:07:51:596 4360 sec: 62137855 operations; 14255.6 current ops/sec; est
completion in 7 hours 9 minutes [INSERT: Count=142547, Max=226303, Min=880, Avg=3502.47, 90=4571,
99=7707, 99.9=192639, 99.99=225279]
18100 2016-03-30 13:08:01:596 4370 sec: 62290243 operations; 15238.8 current ops/sec; est
completion in 7 hours 9 minutes [INSERT: Count=152393, Max=231423, Min=919, Avg=3275.69, 90=4523,
99=6831, 99.9=88447, 99.99=229503]
18101 2016-03-30 13:08:11:596 4380 sec: 62432949 operations; 14270.6 current ops/sec; est
completion in 7 hours 9 minutes [INSERT: Count=142698, Max=205311, Min=910, Avg=3499.68, 90=4631,
99=17071, 99.9=146687, 99.99=202495]
18102 2016-03-30 13:08:21:596 4390 sec: 62574524 operations; 14157.5 current ops/sec; est
completion in 7 hours 9 minutes [INSERT: Count=141581, Max=259071, Min=918, Avg=3526.68, 90=4443,
99=6627, 99.9=189055, 99.99=257151]
18103 2016-03-30 13:08:31:596 4400 sec: 62710962 operations; 13643.8 current ops/sec; est
completion in 7 hours 8 minutes [INSERT: Count=136431, Max=220671, Min=877, Avg=3606.32, 90=4547,
99=26495, 99.9=194303, 99.99=217855]
18104 2016-03-30 13:08:41:596 4410 sec: 62859312 operations; 14835 current ops/sec; est completion
in 7 hours 8 minutes [INSERT: Count=148350, Max=258303, Min=957, Avg=3413.23, 90=4543, 99=7787,
99.9=121663, 99.99=256255]
18105 2016-03-30 13:08:51:596 4420 sec: 63003208 operations; 14389.6 current ops/sec; est
completion in 7 hours 8 minutes [INSERT: Count=143896, Max=226559, Min=957, Avg=3468.59, 90=4631,
99=7127, 99.9=126783, 99.99=225535]
18106 2016-03-30 13:09:01:596 4430 sec: 63147394 operations; 14418.6 current ops/sec; est
completion in 7 hours 8 minutes [INSERT: Count=144193, Max=202751, Min=931, Avg=3465.31, 90=4443,
99=15271, 99.9=122879, 99.99=200959]
18107 2016-03-30 13:09:11:596 4440 sec: 63283125 operations; 13573.1 current ops/sec; est
completion in 7 hours 8 minutes [INSERT: Count=135739, Max=527871, Min=919, Avg=3678.7, 90=4567,
99=9375, 99.9=159615, 99.99=525311]
{code}

{code}
2016-03-30 13:35:26:261 1130 sec: 18067105 operations; 16813.1 current ops/sec; est completion
in 7 hours 8 minutes [INSERT: Count=168133, Max=52863, Min=437, Avg=2970.54, 90=5899, 99=10199,
99.9=35903, 99.99=50623]
2016-03-30 13:35:36:261 1140 sec: 18223814 operations; 15670.9 current ops/sec; est completion
in 7 hours 8 minutes [INSERT: Count=156711, Max=175103, Min=426, Avg=3185.56, 90=5767, 99=19727,
99.9=80639, 99.99=173055]
2016-03-30 13:35:46:261 1150 sec: 18398146 operations; 17433.2 current ops/sec; est completion
in 7 hours 8 minutes [INSERT: Count=174328, Max=54815, Min=452, Avg=2862.38, 90=5575, 99=8079,
99.9=43615, 99.99=53759]
2016-03-30 13:35:56:262 1160 sec: 18561746 operations; 16360 current ops/sec; est completion
in 7 hours 8 minutes [INSERT: Count=163605, Max=95423, Min=434, Avg=3051.5, 90=5775, 99=19503,
99.9=47967, 99.99=94015]
2016-03-30 13:36:06:261 1170 sec: 18725215 operations; 16346.9 current ops/sec; est completion
in 7 hours 7 minutes [INSERT: Count=163471, Max=83327, Min=443, Avg=3053.24, 90=5787, 99=14263,
99.9=47615, 99.99=80767]
2016-03-30 13:36:16:261 1180 sec: 18875810 operations; 15059.5 current ops/sec; est completion
in 7 hours 7 minutes [INSERT: Count=150615, Max=452863, Min=434, Avg=3314.69, 90=5867, 99=13527,
99.9=83135, 99.99=451327]
2016-03-30 13:36:26:262 1190 sec: 19038377 operations; 16256.7 current ops/sec; est completion
in 7 hours 7 minutes [INSERT: Count=162549, Max=155775, Min=409, Avg=3069.92, 90=5731, 99=13287,
99.9=79935, 99.99=153087]
2016-03-30 13:36:36:261 1200 sec: 19172700 operations; 13432.3 current ops/sec; est completion
in 7 hours 8 minutes [INSERT: Count=134331, Max=452863, Min=395, Avg=3716.84, 90=5907, 99=19503,
99.9=224767, 99.99=447999]
2016-03-30 13:36:46:261 1210 sec: 19335308 operations; 16260.8 current ops/sec; est completion
in 7 hours 7 minutes [INSERT: Count=162597, Max=53567, Min=419, Avg=3068.85, 90=5795, 99=20303,
99.9=36927, 99.99=51423]
2016-03-30 13:36:56:262 1220 sec: 19495705 operations; 16039.7 current ops/sec; est completion
in 7 hours 7 minutes [INSERT: Count=160405, Max=181631, Min=389, Avg=3112.64, 90=5551, 99=21279,
99.9=79807, 99.99=179455]
2016-03-30 13:37:06:262 1230 sec: 19655942 operations; 16023.7 current ops/sec; est completion
in 7 hours 7 minutes [INSERT: Count=160231, Max=139391, Min=417, Avg=3115.05, 90=5887, 99=19007,
99.9=51839, 99.99=138111]
2016-03-30 13:37:16:261 1240 sec: 19821754 operations; 16581.2 current ops/sec; est completion
in 7 hours 7 minutes [INSERT: Count=165821, Max=40959, Min=379, Avg=3010.21, 90=5939, 99=9935,
99.9=35327, 99.99=39839]
2016-03-30 13:37:26:262 1250 sec: 19971497 operations; 14974.3 current ops/sec; est completion
in 7 hours 7 minutes [INSERT: Count=149737, Max=207871, Min=426, Avg=3333.67, 90=5947, 99=19967,
99.9=82687, 99.99=205055]
2016-03-30 13:37:36:262 1260 sec: 20138068 operations; 16657.1 current ops/sec; est completion
in 7 hours 6 minutes [INSERT: Count=166571, Max=74239, Min=408, Avg=2996.29, 90=5723, 99=12191,
99.9=39999, 99.99=72063]
{code}

Roughly 14.3k vs 16.3k... about 10-15% more throughput?

> Make AsyncFSWAL as our default WAL
> ----------------------------------
>
>                 Key: HBASE-15536
>                 URL: https://issues.apache.org/jira/browse/HBASE-15536
>             Project: HBase
>          Issue Type: Sub-task
>            Reporter: Duo Zhang
>
> As it should be predicated on passing basic cluster ITBLL



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message