hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-10371) Compaction creates empty hfile, then selects this file for compaction and creates empty hfile and over again
Date Sat, 18 Jan 2014 00:51:22 GMT

    [ https://issues.apache.org/jira/browse/HBASE-10371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13875446#comment-13875446
] 

Hudson commented on HBASE-10371:
--------------------------------

SUCCESS: Integrated in HBase-0.98 #92 (See [https://builds.apache.org/job/HBase-0.98/92/])
HBASE-10371 Compaction creates empty hfile, then selects this file for compaction and creates
empty hfile and over again (Tedyu: rev 1559248)
* /hbase/branches/0.98/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/compactions/RatioBasedCompactionPolicy.java
* /hbase/branches/0.98/hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/MockStoreFile.java
* /hbase/branches/0.98/hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestDefaultCompactSelection.java


> Compaction creates empty hfile, then selects this file for compaction and creates empty
hfile and over again
> ------------------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-10371
>                 URL: https://issues.apache.org/jira/browse/HBASE-10371
>             Project: HBase
>          Issue Type: Bug
>            Reporter: binlijin
>            Assignee: binlijin
>         Attachments: 10371-trunk-3.patch, HBASE-10371-94.patch, HBASE-10371-trunk-2.patch,
HBASE-10371-trunk.patch
>
>
> (1) Select HFile for compaction
> {code}
> 2014-01-16 01:01:25,111 INFO org.apache.hadoop.hbase.regionserver.compactions.CompactSelection:
Deleting the expired store file by compaction: hdfs://dump002002.cm6:9000/hbase-0.90/storagetable/7d8941661904fb99a41f79a1fce47767/a/f3e38d10d579420494079e17a2557f0b
whose maxTimeStamp is -1 while the max expired timestamp is 1389632485111
> {code}
> (2) Compact
> {code}
> 2014-01-16 01:01:26,042 DEBUG org.apache.hadoop.hbase.regionserver.Compactor: Compacting
hdfs://dump002002.cm6:9000/hbase-0.90/storagetable/7d8941661904fb99a41f79a1fce47767/a/f3e38d10d579420494079e17a2557f0b,
keycount=0, bloomtype=NONE, size=534, encoding=NONE
> 2014-01-16 01:01:26,045 DEBUG org.apache.hadoop.hbase.util.FSUtils: Creating file=hdfs://dump002002.cm6:9000/hbase-0.90/storagetable/7d8941661904fb99a41f79a1fce47767/.tmp/40de5d79f80e4fb197e409fb99ab0fd8
with permission=rwxrwxrwx
> 2014-01-16 01:01:26,076 INFO org.apache.hadoop.hbase.regionserver.Store: Renaming compacted
file at hdfs://dump002002.cm6:9000/hbase-0.90/storagetable/7d8941661904fb99a41f79a1fce47767/.tmp/40de5d79f80e4fb197e409fb99ab0fd8
to hdfs://dump002002.cm6:9000/hbase-0.90/storagetable/7d8941661904fb99a41f79a1fce47767/a/40de5d79f80e4fb197e409fb99ab0fd8
> 2014-01-16 01:01:26,142 INFO org.apache.hadoop.hbase.regionserver.Store: Completed compaction
of 1 file(s) in a of storagetable,01:,1369377609136.7d8941661904fb99a41f79a1fce47767. into
40de5d79f80e4fb197e409fb99ab0fd8, size=534; total size for store is 399.0 M
> 2014-01-16 01:01:26,142 INFO org.apache.hadoop.hbase.regionserver.compactions.CompactionRequest:
completed compaction: regionName=storagetable,01:,1369377609136.7d8941661904fb99a41f79a1fce47767.,
storeName=a, fileCount=1, fileSize=534, priority=16, time=18280340606333745; duration=0sec
> {code}
> (3) Select HFile for compaction
> {code}
> 2014-01-16 03:48:05,120 INFO org.apache.hadoop.hbase.regionserver.compactions.CompactSelection:
Deleting the expired store file by compaction: hdfs://dump002002.cm6:9000/hbase-0.90/storagetable/7d8941661904fb99a41f79a1fce47767/a/40de5d79f80e4fb197e409fb99ab0fd8
whose maxTimeStamp is -1 while the max expired timestamp is 1389642485120
> {code}
> (4) Compact
> {code}
> 2014-01-16 03:50:17,731 DEBUG org.apache.hadoop.hbase.regionserver.Compactor: Compacting
hdfs://dump002002.cm6:9000/hbase-0.90/storagetable/7d8941661904fb99a41f79a1fce47767/a/40de5d79f80e4fb197e409fb99ab0fd8,
keycount=0, bloomtype=NONE, size=534, encoding=NONE
> 2014-01-16 03:50:17,732 DEBUG org.apache.hadoop.hbase.util.FSUtils: Creating file=hdfs://dump002002.cm6:9000/hbase-0.90
> {code}
> ... 
> this loop for ever.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Mime
View raw message