hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "stack (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HBASE-618) We always compact if 2 files, regardless of the compaction threshold setting
Date Wed, 07 May 2008 17:02:57 GMT

     [ https://issues.apache.org/jira/browse/HBASE-618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

stack updated HBASE-618:
------------------------

    Resolution: Fixed
        Status: Resolved  (was: Patch Available)

Committed branch and trunk

> We always compact if 2 files, regardless of the compaction threshold setting
> ----------------------------------------------------------------------------
>
>                 Key: HBASE-618
>                 URL: https://issues.apache.org/jira/browse/HBASE-618
>             Project: Hadoop HBase
>          Issue Type: Bug
>    Affects Versions: 0.2.0, 0.1.2
>            Reporter: stack
>            Priority: Blocker
>             Fix For: 0.2.0, 0.1.2
>
>         Attachments: compaction.patch
>
>
> We will always compact if there are two files in a store.  Here is an illustration from
a loading run against 0.1.2 candidate:
> {code}
> 2008-05-06 18:25:42,255 INFO org.apache.hadoop.hbase.HRegion: starting compaction on
region category_rule_pricebin_statistics,,1210116131965
> 2008-05-06 18:25:42,259 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 2
files [329657396/confidence_interval/1251369679869294899, 329657396/confidence_interval/5238351815319958452]
into /hbase/category_rule_pricebin_statistics/compaction.dir/329657396/confidence_interval/mapfiles/6688946093979715350
> 2008-05-06 18:25:46,223 DEBUG org.apache.hadoop.hbase.HStore: moving /hbase/category_rule_pricebin_statistics/compaction.dir/329657396/confidence_interval/mapfiles/6688946093979715350
to /hbase/category_rule_pricebin_statistics/329657396/confidence_interval/mapfiles/6019580165435904305
> 2008-05-06 18:25:46,329 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 2
files [329657396/rule_id/4877828519309794708, 329657396/rule_id/3736239181369788409] into
/hbase/category_rule_pricebin_statistics/compaction.dir/329657396/rule_id/mapfiles/6451418039787481756
> 2008-05-06 18:25:50,273 DEBUG org.apache.hadoop.hbase.HStore: moving /hbase/category_rule_pricebin_statistics/compaction.dir/329657396/rule_id/mapfiles/6451418039787481756
to /hbase/category_rule_pricebin_statistics/329657396/rule_id/mapfiles/1365174520347083269
> 2008-05-06 18:25:50,338 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 2
files [329657396/hidden_variable/7348598912095388790, 329657396/hidden_variable/1402264537929464657]
into /hbase/category_rule_pricebin_statistics/compaction.dir/329657396/hidden_variable/mapfiles/7895992615693344978
> 2008-05-06 18:25:54,103 DEBUG org.apache.hadoop.hbase.HStore: moving /hbase/category_rule_pricebin_statistics/compaction.dir/329657396/hidden_variable/mapfiles/7895992615693344978
to /hbase/category_rule_pricebin_statistics/329657396/hidden_variable/mapfiles/4450886729060218942
> 2008-05-06 18:25:54,155 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 2
files [329657396/category_id/6976628214412388959, 329657396/category_id/8426537623290869905]
into /hbase/category_rule_pricebin_statistics/compaction.dir/329657396/category_id/mapfiles/4017716533879305176
> 2008-05-06 18:25:57,698 DEBUG org.apache.hadoop.hbase.HStore: moving /hbase/category_rule_pricebin_statistics/compaction.dir/329657396/category_id/mapfiles/4017716533879305176
to /hbase/category_rule_pricebin_statistics/329657396/category_id/mapfiles/657561173732096591
> 2008-05-06 18:25:57,747 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 2
files [329657396/price_bin_id/165701488423589566, 329657396/price_bin_id/5537046322320665760]
into /hbase/category_rule_pricebin_statistics/compaction.dir/329657396/price_bin_id/mapfiles/3214618236668106036
> 2008-05-06 18:26:01,135 DEBUG org.apache.hadoop.hbase.HStore: moving /hbase/category_rule_pricebin_statistics/compaction.dir/329657396/price_bin_id/mapfiles/3214618236668106036
to /hbase/category_rule_pricebin_statistics/329657396/price_bin_id/mapfiles/8727588456978537416
> 2008-05-06 18:26:01,181 INFO org.apache.hadoop.hbase.HRegion: compaction completed on
region category_rule_pricebin_statistics,,1210116131965 in 18sec
> {code}
> In the above, the region has 6 families, each of which is being loaded fairly evenly.
  Every time through we'll compact a store if two files, which just so happens to be most
of the time in this case.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message