hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Nicolas Spiegelberg (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-8423) Allow Major Compaction to Use Different Compression
Date Thu, 25 Apr 2013 19:06:16 GMT

    [ https://issues.apache.org/jira/browse/HBASE-8423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13642092#comment-13642092
] 

Nicolas Spiegelberg commented on HBASE-8423:
--------------------------------------------

Oh, also note that this is super useful for us because we also use TimeRange filters to filter
out older, major compacted files in a lot of use cases.
                
> Allow Major Compaction to Use Different Compression
> ---------------------------------------------------
>
>                 Key: HBASE-8423
>                 URL: https://issues.apache.org/jira/browse/HBASE-8423
>             Project: HBase
>          Issue Type: Improvement
>            Reporter: Nicolas Spiegelberg
>            Priority: Minor
>              Labels: compaction, regionserver
>
> For the Messages use case, ~90% of the disk util is associated with major compacted files
but less than 33% of the get IOPS are due to mc files.  Allowing a different compaction algorithm
for major compacted files will allow us to get ~30% disk savings.  Latency should be higher,
but storefile querying is sequential, so only 1/3 of the get latency is from disk access to
these files.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message