hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Nicolas Spiegelberg (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-8155) Allow Record Compression for HLogs
Date Wed, 20 Mar 2013 16:13:17 GMT

    [ https://issues.apache.org/jira/browse/HBASE-8155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13607782#comment-13607782
] 

Nicolas Spiegelberg commented on HBASE-8155:
--------------------------------------------

In high bandwidth systems (our transactional records average 10KB), this give substantial
size savings.  Preliminary results show 3x compression on LZO with minimal throughput savings.
 This got more attention recently because it subsequently facilitates longer log retention
for backup & replication purposes.
                
> Allow Record Compression for HLogs
> ----------------------------------
>
>                 Key: HBASE-8155
>                 URL: https://issues.apache.org/jira/browse/HBASE-8155
>             Project: HBase
>          Issue Type: New Feature
>          Components: regionserver, wal
>            Reporter: Nicolas Spiegelberg
>            Priority: Trivial
>
> While HBASE-4608 allows for Key-intelligent log compression & custom extensions,
Hadoop already allows for native compression support with SequenceFile.  We should allow the
user to enable this functionality through the config.  Besides backwards compatibility &
existing stabilized code, allowing users to enable record-level WAL support will allow support
value compression.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message