hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lars Hofhansl (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-14352) Replication is terribly slow with WAL compression
Date Wed, 16 Sep 2015 23:35:46 GMT

    [ https://issues.apache.org/jira/browse/HBASE-14352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14791304#comment-14791304
] 

Lars Hofhansl commented on HBASE-14352:
---------------------------------------

That's a good point. If there's no advantage to compresses WALs ever, let's get rid of the
code.

I think [~abhishek.chouhan] found write performance neutral with much reduced storage (20%).
Only replication was significantly slower. Would certainly be nice if we could compress between
DC when doing replication (but that's a different issue).

> Replication is terribly slow with WAL compression
> -------------------------------------------------
>
>                 Key: HBASE-14352
>                 URL: https://issues.apache.org/jira/browse/HBASE-14352
>             Project: HBase
>          Issue Type: Bug
>    Affects Versions: 0.98.13
>            Reporter: Abhishek Singh Chouhan
>         Attachments: age_of_last_shipped.png, size_of_log_queue.png
>
>
> For the same load, replication with WAL compression enabled is almost 6x slower than
with compression turned off. Age of last shipped operation is also correspondingly much higher
when compression is turned on. 
> By observing Size of log queue we can see that it is taking too much time for the queue
to clear up.
> Attaching corresponding graphs.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message