hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Heng Chen (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HBASE-16652) Figure out performance difference between increment and append
Date Tue, 20 Sep 2016 09:18:20 GMT

    [ https://issues.apache.org/jira/browse/HBASE-16652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15506121#comment-15506121
] 

Heng Chen edited comment on HBASE-16652 at 9/20/16 9:17 AM:
------------------------------------------------------------

add time log for each step in append/increment path (1.diff),  and do tests with PE 3 times.
 

steps:
1.  delete 'TestTable'
2.  run pe for append 3 times
3.  delete 'TestTable'
4.  run pe for increment 3 times


|| type || client_time || reckonDeltas || doWALAppend || sync ||
|| a_1 || 2.06ms || 0.06ms || 1.7ms || 1.6ms ||
|| a_2 || 1.81ms || 0.05ms || 1.4ms || 1.3ms ||
|| a_3 || 1.87ms || 0.05ms || 1.5ms || 1.4ms ||
|| i_1 || 2.47ms || 0.05ms || 2.1ms || 2.0ms ||
|| i_2 || 2.39ms || 0.06ms || 2.0ms || 1.9ms ||
|| i_3 || 2.36ms || 0.06ms || 2.0ms || 1.9ms ||

Notes:  it is one operation time in average.  


It seems the main difference is sync wal??


was (Author: chenheng):
add time log for each step in append/increment path (1.diff),  and do tests with PE 3 times.
 

steps:
1.  delete 'TestTable'
2.  run pe for append 3 times
3.  delete 'TestTable'
4.  run pe for increment 3 times


|| type || client_time || reckonDeltas || doWALAppend || sync ||
|| a_1 || 2.06ms || 0.06ms || 1.7ms || 1.6ms ||
|| a_2 || 1.81ms || 0.05ms || 1.4ms || 1.3ms ||
|| a_3 || 1.87ms || 0.05ms || 1.5ms || 1.4ms ||
|| i_1 || 2.47ms || 0.05ms || 2.1ms || 2.0ms ||
|| i_2 || 2.39ms || 0.06ms || 2.0ms || 1.9ms ||
|| i_3 || 2.36ms || 0.06ms || 2.0ms || 1.9ms ||


It seems the main difference is sync wal??

> Figure out performance difference between increment and append
> --------------------------------------------------------------
>
>                 Key: HBASE-16652
>                 URL: https://issues.apache.org/jira/browse/HBASE-16652
>             Project: HBase
>          Issue Type: Sub-task
>            Reporter: Heng Chen
>              Labels: performance
>         Attachments: 1.diff, HBASE-16652.patch, append.jfr, append_get_profile.png, increment.jfr,
increment_get_profile.png
>
>
> When do performance test in HBASE-16625,  i found it has the very big difference between
Append and Increment (append is about 37% faster than increment).
> As [~stack] mentioned in https://issues.apache.org/jira/browse/HBASE-16610?focusedCommentId=15493166&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-15493166,
  append and increment has been unified in server-side,  and they looks the same in client-side.

> This issue is to figure out why the performance looks different between them.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message