cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Stu Hood (JIRA)" <j...@apache.org>
Subject [jira] Updated: (CASSANDRA-790) SSTables limited to (2^31)/15 keys
Date Sun, 14 Feb 2010 04:20:27 GMT

     [ https://issues.apache.org/jira/browse/CASSANDRA-790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Stu Hood updated CASSANDRA-790:
-------------------------------

    Attachment: 0002-Add-timeouts-to-forceBlockingFlush-during-tests.patch
                0001-Change-parameters-to-BloomCalculations-in-order-to-c.patch

Better implementation of the short term solution. Rather than capping the total number of
buckets, this patch caps the number of buckets per element.

The second patch adds timeouts to blocking flushes, to minimize hanging tests.

> SSTables limited to (2^31)/15 keys
> ----------------------------------
>
>                 Key: CASSANDRA-790
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-790
>             Project: Cassandra
>          Issue Type: Bug
>    Affects Versions: 0.5, 0.6, 0.7
>            Reporter: Stu Hood
>            Priority: Blocker
>             Fix For: 0.5, 0.6, 0.7
>
>         Attachments: 0001-Change-parameters-to-BloomCalculations-in-order-to-c.patch,
0002-Add-timeouts-to-forceBlockingFlush-during-tests.patch
>
>
> The current BloomFilter implementation requires a BitSet of (bucket_count * num_keys)
in size, and that calculation is currently performed in an integer, which causes overflow
for around 140 million keys in one SSTable.
> Short term fix: perform the calculation in a long, and cap the value to the maximum size
of a BitSet.
> Long term fix: begin partitioning BitSets, perhaps using Linear Bloom Filters.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message