Return-Path: X-Original-To: apmail-cassandra-commits-archive@www.apache.org Delivered-To: apmail-cassandra-commits-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 69D5A7EBF for ; Tue, 13 Dec 2011 16:28:00 +0000 (UTC) Received: (qmail 98684 invoked by uid 500); 13 Dec 2011 16:28:00 -0000 Delivered-To: apmail-cassandra-commits-archive@cassandra.apache.org Received: (qmail 98654 invoked by uid 500); 13 Dec 2011 16:28:00 -0000 Mailing-List: contact commits-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@cassandra.apache.org Delivered-To: mailing list commits@cassandra.apache.org Received: (qmail 98646 invoked by uid 99); 13 Dec 2011 16:28:00 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 13 Dec 2011 16:28:00 +0000 X-ASF-Spam-Status: No, hits=-2001.5 required=5.0 tests=ALL_TRUSTED,RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 13 Dec 2011 16:27:51 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id C8EFC110FF1 for ; Tue, 13 Dec 2011 16:27:30 +0000 (UTC) Date: Tue, 13 Dec 2011 16:27:30 +0000 (UTC) From: "Radim Kolar (Commented) (JIRA)" To: commits@cassandra.apache.org Message-ID: <561937644.6173.1323793650824.JavaMail.tomcat@hel.zones.apache.org> In-Reply-To: <456239589.50498.1321860171739.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Commented] (CASSANDRA-3511) Supercolumn key caches are not saved MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/CASSANDRA-3511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13168480#comment-13168480 ] Radim Kolar commented on CASSANDRA-3511: ---------------------------------------- This is also cache save issue because i seen case where after loading cache saved by 1.0.5 cache is not saved anymore. I will attach another demonstration file. Problems are 2: 1. cache can be saved in incorrect format (maybe truncated?). Save to -tmp and rename later? 2. loading incorrect cache save image will cause that cache is not saved anymore. Incorrect image is not overwritten by a good one. Add some kind of error/checksum to cache for detecting and rejecting incorrect cache save images during load. > Supercolumn key caches are not saved > ------------------------------------ > > Key: CASSANDRA-3511 > URL: https://issues.apache.org/jira/browse/CASSANDRA-3511 > Project: Cassandra > Issue Type: Bug > Components: Core > Affects Versions: 1.0.2, 1.0.3 > Reporter: Radim Kolar > Priority: Minor > Labels: supercolumns > Attachments: rapidshare-resultcache-KeyCache > > > cache saving seems to be broken in 1.0.2 and 1.0.3 i have 2 CF in keyspace with enabled cache saving and only one gets its key cache saved. It worked perfectly in 0.8, both were saved. > This one works: > create column family query2 > with column_type = 'Standard' > and comparator = 'AsciiType' > and default_validation_class = 'BytesType' > and key_validation_class = 'UTF8Type' > and rows_cached = 500.0 > and row_cache_save_period = 0 > and row_cache_keys_to_save = 2147483647 > and keys_cached = 200000.0 > and key_cache_save_period = 14400 > and read_repair_chance = 1.0 > and gc_grace = 864000 > and min_compaction_threshold = 5 > and max_compaction_threshold = 10 > and replicate_on_write = false > and row_cache_provider = 'ConcurrentLinkedHashCacheProvider' > and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy' > This does not > create column family dkb13 > with column_type = 'Super' > and comparator = 'LongType' > and subcomparator = 'AsciiType' > and default_validation_class = 'BytesType' > and key_validation_class = 'UTF8Type' > and rows_cached = 600.0 > and row_cache_save_period = 0 > and row_cache_keys_to_save = 2147483647 > and keys_cached = 200000.0 > and key_cache_save_period = 14400 > and read_repair_chance = 1.0 > and gc_grace = 864000 > and min_compaction_threshold = 5 > and max_compaction_threshold = 10 > and replicate_on_write = false > and row_cache_provider = 'ConcurrentLinkedHashCacheProvider' > and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy' > in second test system i created these 2 column families and none of them got single cache key saved. Both have save period 30 seoonds - their cache should save often. Its not that standard column family works while super does not. > create column family test1 > with column_type = 'Standard' > and comparator = 'BytesType' > and default_validation_class = 'BytesType' > and key_validation_class = 'BytesType' > and rows_cached = 0.0 > and row_cache_save_period = 0 > and row_cache_keys_to_save = 2147483647 > and keys_cached = 200000.0 > and key_cache_save_period = 30 > and read_repair_chance = 1.0 > and gc_grace = 864000 > and min_compaction_threshold = 4 > and max_compaction_threshold = 32 > and replicate_on_write = true > and row_cache_provider = 'SerializingCacheProvider' > and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy'; > create column family test2 > with column_type = 'Standard' > and comparator = 'BytesType' > and default_validation_class = 'BytesType' > and key_validation_class = 'BytesType' > and rows_cached = 0.0 > and row_cache_save_period = 0 > and row_cache_keys_to_save = 2147483647 > and keys_cached = 200000.0 > and key_cache_save_period = 30 > and read_repair_chance = 1.0 > and gc_grace = 864000 > and min_compaction_threshold = 4 > and max_compaction_threshold = 32 > and replicate_on_write = true > and row_cache_provider = 'SerializingCacheProvider' > and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy'; > If this is done on purpose for example cassandra 1.0 is doing some heuristic decision if cache should be saved or not then it should be removed. Saving cache is fast. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira