hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From stack <st...@duboce.net>
Subject Re: new compaction code
Date Tue, 19 May 2009 15:38:05 GMT
hot dog!
St.Ack

On Tue, May 19, 2009 at 3:09 AM, Ryan Rawson <ryanobjc@gmail.com> wrote:

> hey guys,
>
> the new compaction code is in:
>
>
> http://github.com/ryanobjc/hbase/commit/cc2b7faca2cf609dac03ef9bf4cadefdd270ae91
>
> the test passes too!
>
> the new compaction model is one of a full scan over all the files in
> question.  if we are doing a 'major' then use the normal scanner, which
> prunes all 'delete' entries.  If we are doing a minor, then a different
> scanner will return delete records, but prune the puts that were filtered
> by
> them, and of course, return non-filtered puts as well.  The minor doesn't
> enforce max version or TTL, and the major compaction does.
>
> making really good progress on 1304 - working scanners, working get, fixed
> memcache (with passing test to cover the lingering delete entry we
> discussed
> on irc), compactions.
>
> Next is to get rid of all the old get() and scan() code, replace it with
> new
> code, and fix any potential META problems.
>
> -ryan
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message