hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Duo Zhang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-17049) Find out why AsyncFSWAL issues much more syncs than FSHLog
Date Tue, 06 Dec 2016 14:07:58 GMT

    [ https://issues.apache.org/jira/browse/HBASE-17049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15725574#comment-15725574

Duo Zhang commented on HBASE-17049:

I planned to run a single node HBase on a distributed HDFS, but the testing node which is
in the same DC of the HDFS cluster is used by others these days. Will try this later, or I
will just run a PE on a fully distributed cluster(both HBase and HDFS).

And I have run a single node PE test with multiwal, BoundedGroupingStrategy, 8 wals.

./bin/hbase org.apache.hadoop.hbase.PerformanceEvaluation --nomapred --presplit=50 --size=50
--columns=50 --valueSize=200 --writeToWAL=true --bloomFilter=NONE randomWrite 50

FSHLog: Min: 392959ms   Max: 413928ms   Avg: 406991ms
AsyncFSWAL: Min: 359566ms   Max: 397469ms   Avg: 391964ms

AsyncFSWAL is a bit faster. So I think this is the right way to increase the performance of

[~stack] Can you try to see if this also works for you sir? Both [~ram_krish] and I can get
a better result with multiwal(although in ram's test AsyncFSWAL is still a bit slower).


> Find out why AsyncFSWAL issues much more syncs than FSHLog
> ----------------------------------------------------------
>                 Key: HBASE-17049
>                 URL: https://issues.apache.org/jira/browse/HBASE-17049
>             Project: HBase
>          Issue Type: Sub-task
>          Components: wal
>    Affects Versions: 2.0.0
>            Reporter: Duo Zhang
>             Fix For: 2.0.0
>         Attachments: delay-sync.patch
> https://issues.apache.org/jira/browse/HBASE-16890?focusedCommentId=15647590&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-15647590

This message was sent by Atlassian JIRA

View raw message