hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Purtell (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HBASE-18165) Predicate based deletion during major compactions
Date Mon, 05 Jun 2017 21:44:04 GMT

    [ https://issues.apache.org/jira/browse/HBASE-18165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037650#comment-16037650
] 

Andrew Purtell edited comment on HBASE-18165 at 6/5/17 9:43 PM:
----------------------------------------------------------------

bq.  We've long toyed with the idea of trying to push column custom logic into compaction
via a coprocessor. However, a well defined but simpler interface, similar to Filter would
make it much easier to do.

Filters or other transformations that run at compaction time are essentially the Accumulo
Iterators idea. We've had this proposed in other contexts. I guess I have the same question
now as then, why not implement support for Accumulo-style Iterators? Something like https://github.com/carlaustin/hbase-accumulo-iterators
(Warning: Do not use directly, not correctly licensed!)


was (Author: apurtell):
Filters or other transformations that run at compaction time are essentially the Accumulo
Iterators idea. We've had this proposed in other contexts. I guess I have the same question
now as then, why not implement support for Accumulo-style Iterators? Something like https://github.com/carlaustin/hbase-accumulo-iterators
(Warning: Do not use directly, not correctly licensed!)

> Predicate based deletion during major compactions
> -------------------------------------------------
>
>                 Key: HBASE-18165
>                 URL: https://issues.apache.org/jira/browse/HBASE-18165
>             Project: HBase
>          Issue Type: Brainstorming
>            Reporter: Lars Hofhansl
>
> In many cases it is expensive to place a delete per version, column, or family.
> HBase should have way to specify a predicate and remove all Cells matching the predicate
during the next compactions (major and minor).
> Nothing more concrete. The tricky part would be to know when it is safe to remove the
predicate, i.e. when we can be sure that all Cells matching the predicate actually have been
removed.
> Could potentially use HBASE-12859 for that.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message