hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "stack (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HBASE-3158) Bloom File Writes Broken if keySize is large
Date Wed, 27 Oct 2010 04:18:20 GMT

     [ https://issues.apache.org/jira/browse/HBASE-3158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

stack updated HBASE-3158:
-------------------------

       Resolution: Fixed
    Fix Version/s: 0.90.0
     Hadoop Flags: [Reviewed]
           Status: Resolved  (was: Patch Available)

Thanks for the fix Nicolas (I like the BBQ exception).

> Bloom File Writes Broken if keySize is large
> --------------------------------------------
>
>                 Key: HBASE-3158
>                 URL: https://issues.apache.org/jira/browse/HBASE-3158
>             Project: HBase
>          Issue Type: Bug
>    Affects Versions: 0.90.0
>            Reporter: Nicolas Spiegelberg
>            Assignee: Nicolas Spiegelberg
>            Priority: Blocker
>             Fix For: 0.90.0
>
>         Attachments: HBASE-3158.patch
>
>
> Yesterday, on our cluster, a region compact() kept crashing at giving this stack trace
> 2010-10-25 08:48:28,330 ERROR org.apache.hadoop.hbase.regionserver.CompactSplitThread:
Compaction failed for region MailBox_dark_launch_2010_10-04,4b64b600,1286302852538.9183a3b91ebd289bab7724d028cffa69.
> java.lang.IllegalArgumentException: maxValue must be > 0
> at org.apache.hadoop.hbase.util.ByteBloomFilter.sanityCheck(ByteBloomFilter.java:170)
> at org.apache.hadoop.hbase.util.ByteBloomFilter.<init>(ByteBloomFilter.java:156)
> at org.apache.hadoop.hbase.regionserver.StoreFile$Writer.<init>(StoreFile.java:707)
> at org.apache.hadoop.hbase.regionserver.StoreFile.createWriter(StoreFile.java:566)
> at org.apache.hadoop.hbase.regionserver.Store.createWriterInTmp(Store.java:504)
> at org.apache.hadoop.hbase.regionserver.Store.compact(Store.java:817)
> at org.apache.hadoop.hbase.regionserver.Store.compact(Store.java:678)
> at org.apache.hadoop.hbase.regionserver.HRegion.compactStores(HRegion.java:842)
> at org.apache.hadoop.hbase.regionserver.HRegion.compactStores(HRegion.java:793)
> at org.apache.hadoop.hbase.regionserver.CompactSplitThread.run(CompactSplitThread.java:103)
> The problem is that we are oveflowing "int" for "bitSize". The number of keys is about
272M, and we are using about 11 bit per key. So, bitSize ends up being > 2G..

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message