hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "stack (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-19323) Make netty engine default in hbase2
Date Tue, 05 Dec 2017 22:36:00 GMT

    [ https://issues.apache.org/jira/browse/HBASE-19323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16279302#comment-16279302
] 

stack commented on HBASE-19323:
-------------------------------

Ran ycsb-0.12 against a cluster of a Master and single RegionServer standing over an HDFS
of seven datanodes. Only diff is enabling NettyRpcServer in place of SimpleRpcServer. Conclusion
is that netty is generally more performant so I'll enable it as our default unless objection
(Netty is a bit slower doing pure write; does better w/ mixed workload).

Below I extract some of the reported measurements from ycsb.

||workload||SimpleRpcServer||NettyRpcServer||
|loading|4523op/s|4241ops/s|
|loading|1611us 99th|1718us 99th|
|a 50/50|5467 ops/s|6375 ops/s|
|a 50/50|10903us 99th READ|1835us 99th READ|
|a 50/50|1341us 99th UPDATE|1348us 99th UPDATE|
|b 95/5|6377 ops/s|7225 ops/s|
|c 100/0|11202 ops/s|11332 ops/s|

I have other numbers but that'll do I'd say.

Did basically this per workload:

echo "`date` loading"
perf stat "${YCSB}" load "${BINDING}" -P "${WORKLOADS}/workloada" "${WORKLOAD_ARGS[@]}" -p
recordcount=${RECORD_COUNT} \
  -p exportfile="${LOGS}/ycsb-load-measurements-${HERE}-${date}.json" -p exporter="${EXPORTER}"
\
  >"${LOGS}/ycsb-load-${HERE}-${date}.out" 2>"${LOGS}/ycsb-load-${HERE}-${date}.err"




> Make netty engine default in hbase2
> -----------------------------------
>
>                 Key: HBASE-19323
>                 URL: https://issues.apache.org/jira/browse/HBASE-19323
>             Project: HBase
>          Issue Type: Task
>          Components: rpc
>            Reporter: stack
>             Fix For: 2.0.0-beta-1
>
>         Attachments: 0001-HBASE-19323-Make-netty-engine-default-in-hbase2.patch, HBASE-19323.master.001.patch
>
>
> HBASE-17263 added netty rpc server. This issue is about making it default given it has
seen good service across two singles-days at scale. Netty handles the scenario seen in HBASE-19320
(See tail of HBASE-19320 for suggestion to netty the default)



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message