hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "stack (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-8155) Allow Record Compression for HLogs
Date Wed, 20 Mar 2013 18:23:16 GMT

    [ https://issues.apache.org/jira/browse/HBASE-8155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13607954#comment-13607954

stack commented on HBASE-8155:

[~nspiegelberg] SF compresses by the block.  A block may be made of many entries.  Enabling
compression means we could lose more data -- up to a whole block rather than just the last
entry -- if we fail just as we are about to round out the block (or we've written a complete
block and the compressor is still working on flushing it out).  Is your thinking this is ok
as long as the configuration carries sufficient warnings?  Thanks.
> Allow Record Compression for HLogs
> ----------------------------------
>                 Key: HBASE-8155
>                 URL: https://issues.apache.org/jira/browse/HBASE-8155
>             Project: HBase
>          Issue Type: New Feature
>          Components: regionserver, wal
>            Reporter: Nicolas Spiegelberg
>            Priority: Trivial
> While HBASE-4608 allows for Key-intelligent log compression & custom extensions,
Hadoop already allows for native compression support with SequenceFile.  We should allow the
user to enable this functionality through the config.  Besides backwards compatibility &
existing stabilized code, allowing users to enable record-level WAL support will allow support
value compression.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message