hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jonathan Gray (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HBASE-1039) Compaction fails if bloomfilters are enabled
Date Mon, 01 Dec 2008 19:15:44 GMT

    [ https://issues.apache.org/jira/browse/HBASE-1039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12652104#action_12652104
] 

Jonathan Gray commented on HBASE-1039:
--------------------------------------

Correction from Thibaut on list:

{quote}
You are right. I just saw that that table (the only table) has indeed the bloomfilters and
compression enabled (blockcache is disabled).
{NAME => 'entries', IS_ROOT => 'false', IS_META => 'false', FAMILIES => [{NAME
=> 'data', BLOOMFILTER => 'true', COMPRESSION => 'BLOCK', VERSIONS => '3', LENGTH
=> '2147483647', TTL => '-1', IN_MEMORY => 'false', BLOCKCACHE => 'false'}]}

As for the load/dfs errors, thanks for explaining this. I was only starting up one region
server to have all the log entries at one place, and it was indeed under heavy load. (Multiple
threads setting/getting keys)
{quote}

He originally said 8 node cluster, but now makes mention of only single regionserver.  So
one problem seems related to blooms, probably also seeing load-related issues.

> Compaction fails if bloomfilters are enabled
> --------------------------------------------
>
>                 Key: HBASE-1039
>                 URL: https://issues.apache.org/jira/browse/HBASE-1039
>             Project: Hadoop HBase
>          Issue Type: Bug
>          Components: regionserver
>    Affects Versions: 0.18.1
>            Reporter: Andrew Purtell
>
> From Thibaut up on the list.
> As soon as hbase tries to compact the table, the following exception appears in the logfile:
(Other compactations also work fine without any errors)
> 2008-11-30 00:55:57,769 ERROR
> org.apache.hadoop.hbase.regionserver.CompactSplitThread: Compaction failed for region
mytable,,1228002541526
> java.lang.IllegalArgumentException: maxValue must be > 0
>     at org.onelab.filter.HashFunction.<init>(HashFunction.java:84)
>     at org.onelab.filter.Filter.<init>(Filter.java:97)
>     at org.onelab.filter.BloomFilter.<init>(BloomFilter.java:102)
>     at org.apache.hadoop.hbase.regionserver.HStoreFile$BloomFilterMapFile$Writer.<init>(HStoreFile.java:829)
>     at org.apache.hadoop.hbase.regionserver.HStoreFile.getWriter(HStoreFile.java:436)
>     at org.apache.hadoop.hbase.regionserver.HStore.compact(HStore.java:889)
>     at org.apache.hadoop.hbase.regionserver.HRegion.compactStores(HRegion.java:902)
>     at org.apache.hadoop.hbase.regionserver.HRegion.compactStores(HRegion.java:860)
>     at org.apache.hadoop.hbase.regionserver.CompactSplitThread.run(CompactSplitThread.java:83)
> Because the region cannot compact and/or split, it is soon dead after (re)assignment.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message