hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "stack (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HBASE-1083) Will keep scheduling major compactions if last time one ran, we didn't.
Date Tue, 23 Dec 2008 18:08:44 GMT

    [ https://issues.apache.org/jira/browse/HBASE-1083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12658912#action_12658912
] 

stack commented on HBASE-1083:
------------------------------

{code}
18:03 <jgray> seconds some place and millis other?
18:04 <jgray> 2008-12-23 00:48:54,907 DEBUG org.apache.hadoop.hbase.regionserver.HStore:
Major compaction triggered on store: 1631726221/content. Time since last major compaction:
138860 secondsver/0:0:0:0:0:0:0:0:60020.majorCompactionChecker requests mor 
              compaction
18:04 <jgray> 2008-12-23 00:48:54,907 DEBUG org.apache.hadoop.hbase.regionserver.HStore:
Skipping major compaction because only one (major) compacted file only and elapsedTime 138896162
is < ttl=-1
18:04 <St^Ack> somethign likethat
18:04 <jgray> seconds in first line, millis in second
{code}

> Will keep scheduling major compactions if last time one ran, we didn't.
> -----------------------------------------------------------------------
>
>                 Key: HBASE-1083
>                 URL: https://issues.apache.org/jira/browse/HBASE-1083
>             Project: Hadoop HBase
>          Issue Type: Bug
>            Reporter: stack
>             Fix For: 0.19.0
>
>
> Excerpt below has major compactions scheduled ever few hours but nothing to compact each
time through -- last run was a major compaction -- and times are off.  Need to touch files
if nothing to compact so major doesn't get scheduled again.
> {code}
> 2008-12-20 02:41:03,933 DEBUG org.apache.hadoop.hbase.regionserver.HStore: Major compaction
triggered on store: 170018656/content. Time since last major compaction: 249999 seconds
> 2008-12-20 05:27:43,933 DEBUG org.apache.hadoop.hbase.regionserver.HStore: Major compaction
triggered on store: 170018656/content. Time since last major compaction: 259999 seconds
> 2008-12-20 08:14:23,932 DEBUG org.apache.hadoop.hbase.regionserver.HStore: Major compaction
triggered on store: 170018656/content. Time since last major compaction: 269999 seconds
> 2008-12-20 11:01:03,932 DEBUG org.apache.hadoop.hbase.regionserver.HStore: Major compaction
triggered on store: 170018656/content. Time since last major compaction: 279999 seconds
> 2008-12-20 13:47:43,932 DEBUG org.apache.hadoop.hbase.regionserver.HStore: Major compaction
triggered on store: 170018656/content. Time since last major compaction: 289999 seconds
> 2008-12-20 16:34:23,932 DEBUG org.apache.hadoop.hbase.regionserver.HStore: Major compaction
triggered on store: 170018656/content. Time since last major compaction: 299999 seconds
> 2008-12-20 19:21:03,933 DEBUG org.apache.hadoop.hbase.regionserver.HStore: Major compaction
triggered on store: 170018656/content. Time since last major compaction: 309999 seconds
> 2008-12-20 22:07:43,932 DEBUG org.apache.hadoop.hbase.regionserver.HStore: Major compaction
triggered on store: 170018656/content. Time since last major compaction: 319999 seconds
> {code}
> Then it says: 
> {code}
> 2008-12-20 13:47:43,935 DEBUG org.apache.hadoop.hbase.regionserver.HStore: Skipping major
compaction because only one (major) compacted file only and elapsedTime 289999825 is <
ttl=-1
> {code}
> I think whats happening is that we're not compacting because we just did but major compactions
keep getting triggered because we are not updating the file timestamp.  Look into it.  At
least fix up logging so its clearer whats happening..  Here is snippet:
> {code}
> 2008-12-20 11:01:04,026 DEBUG org.apache.hadoop.hbase.regionserver.HStore: Skipping major
compaction because only one (major) compacted file only and elapsedTime 149999850 is <
ttl=-1
> 2008-12-20 11:01:04,026 INFO org.apache.hadoop.hbase.regionserver.HRegion: compaction
completed on region assigners,,1229364037757 in 0sec
> 2008-12-20 13:47:43,932 DEBUG org.apache.hadoop.hbase.regionserver.HStore: Major compaction
triggered on store: 170018656/content. Time since last major compaction: 289999 seconds
> 2008-12-20 13:47:43,932 DEBUG org.apache.hadoop.hbase.regionserver.CompactSplitThread:
Compaction requested for region streamitems,^@^@^@^@^C�r�,1229427582771 because: regionserver/0:0:0:0:0:0:0:0:60020.majorCompactionChecker
requests major compaction
> 2008-12-20 13:47:43,932 INFO org.apache.hadoop.hbase.regionserver.HRegion: starting compaction
on region streamitems,^@^@^@^@^C�r�,1229427582771
> 2008-12-20 13:47:43,934 DEBUG org.apache.hadoop.hbase.regionserver.HStore: Major compaction
triggered on store: 65151897/content. Time since last major compaction: 259999 seconds
> 2008-12-20 13:47:43,934 DEBUG org.apache.hadoop.hbase.regionserver.CompactSplitThread:
Compaction requested for region streamitems,^@^@^@^@^C3=�,1229459727659 because: regionserver/0:0:0:0:0:0:0:0:60020.majorCompactionChecker
requests major compaction
> 2008-12-20 13:47:43,935 DEBUG org.apache.hadoop.hbase.regionserver.HStore: Major compaction
triggered on store: 1579534353/content. Time since last major compaction: 259983 seconds
> 2008-12-20 13:47:43,935 DEBUG org.apache.hadoop.hbase.regionserver.CompactSplitThread:
Compaction requested for region streamitems,^@^@^@^@^AV^Ds,1229459695202 because: regionserver/0:0:0:0:0:0:0:0:60020.majorCompactionChecker
requests major compaction
> 2008-12-20 13:47:43,935 DEBUG org.apache.hadoop.hbase.regionserver.HStore: Skipping major
compaction because only one (major) compacted file only and elapsedTime 289999825 is <
ttl=-1
> 2008-12-20 13:47:43,936 DEBUG org.apache.hadoop.hbase.regionserver.HStore: Major compaction
triggered on store: 1277711984/content. Time since last major compaction: 339999 seconds
> ...
> {code}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message