hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "stack (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-8155) Allow Record Compression for HLogs
Date Wed, 20 Mar 2013 18:23:16 GMT

    [ https://issues.apache.org/jira/browse/HBASE-8155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13607954#comment-13607954
] 

stack commented on HBASE-8155:
------------------------------

[~nspiegelberg] SF compresses by the block.  A block may be made of many entries.  Enabling
compression means we could lose more data -- up to a whole block rather than just the last
entry -- if we fail just as we are about to round out the block (or we've written a complete
block and the compressor is still working on flushing it out).  Is your thinking this is ok
as long as the configuration carries sufficient warnings?  Thanks.
                
> Allow Record Compression for HLogs
> ----------------------------------
>
>                 Key: HBASE-8155
>                 URL: https://issues.apache.org/jira/browse/HBASE-8155
>             Project: HBase
>          Issue Type: New Feature
>          Components: regionserver, wal
>            Reporter: Nicolas Spiegelberg
>            Priority: Trivial
>
> While HBASE-4608 allows for Key-intelligent log compression & custom extensions,
Hadoop already allows for native compression support with SequenceFile.  We should allow the
user to enable this functionality through the config.  Besides backwards compatibility &
existing stabilized code, allowing users to enable record-level WAL support will allow support
value compression.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message