hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Purtell (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HBASE-11331) [blockcache] lazy block decompression
Date Tue, 26 Aug 2014 01:56:01 GMT

    [ https://issues.apache.org/jira/browse/HBASE-11331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14110159#comment-14110159
] 

Andrew Purtell edited comment on HBASE-11331 at 8/26/14 1:56 AM:
-----------------------------------------------------------------

+1 for 0.98.

This is good work.

Didn't relish going through HFile code again (hasn't been long enough since HBASE-7544). Nothing
jumped out to me as wrong. I will try taking another look when not spread so thin.

The schema option needs to be false by default. We can write a note in the release notes and/or
manual that if using compression the user should try enabling the option and only disable
if observing too high CPU usage or too much GC under their workload.

Edit: I reviewed the 0.98 patch


was (Author: apurtell):
+1 for 0.98.

This is good work.

Didn't relish going through HFile code again (hasn't been long enough since HBASE-7544). Nothing
jumped out to me as wrong. I will try taking another look when not spread so thin.

The schema option needs to be false by default. We can write a note in the release notes and/or
manual that if using compression the user should try enabling the option and only disable
if observing too high CPU usage or too much GC under their workload.

> [blockcache] lazy block decompression
> -------------------------------------
>
>                 Key: HBASE-11331
>                 URL: https://issues.apache.org/jira/browse/HBASE-11331
>             Project: HBase
>          Issue Type: Improvement
>          Components: regionserver
>            Reporter: Nick Dimiduk
>            Assignee: Nick Dimiduk
>             Fix For: 0.99.0, 2.0.0, 0.98.6
>
>         Attachments: HBASE-11331.00.patch, HBASE-11331.01.patch, HBASE-11331.02.patch,
HBASE-11331.03.patch, HBASE-11331.04.patch, HBASE-11331.05-0.98.patch, HBASE-11331.05.patch,
HBASE-11331LazyBlockDecompressperfcompare.pdf, hbase-hbase-master-hor17n36.gq1.ygridcore.net.log,
lazy-decompress.02.0.pdf, lazy-decompress.02.1.json, lazy-decompress.02.1.pdf, v03-20g-045g-false.pdf,
v03-20g-045g-true-16h.pdf, v03-20g-045g-true.pdf
>
>
> Maintaining data in its compressed form in the block cache will greatly increase our
effective blockcache size and should show a meaning improvement in cache hit rates in well
designed applications. The idea here is to lazily decompress/decrypt blocks when they're consumed,
rather than as soon as they're pulled off of disk.
> This is related to but less invasive than HBASE-8894.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message