hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jonathan Gray (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HBASE-1521) Optimize codepath for minor compactions
Date Wed, 12 Aug 2009 22:54:14 GMT

     [ https://issues.apache.org/jira/browse/HBASE-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Jonathan Gray updated HBASE-1521:
---------------------------------

    Affects Version/s: 0.21.0
        Fix Version/s:     (was: 0.20.1)
                       0.21.0

Let's revisit for 0.21, seems to be consensus on leaving it for now.

> Optimize codepath for minor compactions
> ---------------------------------------
>
>                 Key: HBASE-1521
>                 URL: https://issues.apache.org/jira/browse/HBASE-1521
>             Project: Hadoop HBase
>          Issue Type: Improvement
>    Affects Versions: 0.20.0, 0.21.0
>            Reporter: Jonathan Gray
>             Fix For: 0.21.0
>
>
> There are some additional optimizations in the specialized StoreScanner and also in HFile
for minor compactions.  For example, there is some KV disassembling and sanity checking in
HFile even though in a minor compaction these checks have already been run during the flush.
> Another area to discuss is whether we should actually process deletes during minor compactions.
 It's not especially expensive (ScanDeleteTracker is quite simple) but it requires looking
at both the row and the qualifier value of every single KV.  Removing this would drop our
axiom that "Deletes only apply to later storefiles", which is used during Get processing to
have more efficient delete handling.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message