hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ramkrishna.s.vasudevan (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HBASE-15554) StoreFile$Writer.appendGeneralBloomFilter generates extra KV
Date Thu, 04 Aug 2016 05:32:21 GMT

     [ https://issues.apache.org/jira/browse/HBASE-15554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

ramkrishna.s.vasudevan updated HBASE-15554:
-------------------------------------------
    Attachment: HBASE-15554_6.patch

Patch that works with ROW and ROWCOL blooms and avoids copying the cell contents every time
a ROWCOL bloom has to be formed. 
Adds BloomContext that has two cases - RowBloomContext and RowColBloomContext.
The Hash algo now works directly with cells. The only assumption the cells are KeyValue format
serialized key. 
Once we have a Key interface we can use that to decide whether to use the cell as it is or
we need to convert the cell to KV and then use it. 

> StoreFile$Writer.appendGeneralBloomFilter generates extra KV
> ------------------------------------------------------------
>
>                 Key: HBASE-15554
>                 URL: https://issues.apache.org/jira/browse/HBASE-15554
>             Project: HBase
>          Issue Type: Sub-task
>          Components: Performance
>            Reporter: Vladimir Rodionov
>            Assignee: ramkrishna.s.vasudevan
>             Fix For: 2.0.0
>
>         Attachments: HBASE-15554.patch, HBASE-15554_3.patch, HBASE-15554_4.patch, HBASE-15554_6.patch
>
>
> Accounts for 10% memory allocation in compaction thread when BloomFilterType is ROWCOL.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message