Return-Path: Delivered-To: apmail-incubator-cassandra-commits-archive@minotaur.apache.org Received: (qmail 10349 invoked from network); 7 Dec 2009 17:25:43 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 7 Dec 2009 17:25:43 -0000 Received: (qmail 14050 invoked by uid 500); 7 Dec 2009 17:25:42 -0000 Delivered-To: apmail-incubator-cassandra-commits-archive@incubator.apache.org Received: (qmail 14004 invoked by uid 500); 7 Dec 2009 17:25:42 -0000 Mailing-List: contact cassandra-commits-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: cassandra-dev@incubator.apache.org Delivered-To: mailing list cassandra-commits@incubator.apache.org Received: (qmail 13740 invoked by uid 99); 7 Dec 2009 17:25:42 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 07 Dec 2009 17:25:42 +0000 X-ASF-Spam-Status: No, hits=-10.5 required=5.0 tests=AWL,BAYES_00,RCVD_IN_DNSWL_HI X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 07 Dec 2009 17:25:38 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id 5339B234C4AF for ; Mon, 7 Dec 2009 09:25:18 -0800 (PST) Message-ID: <466609067.1260206718339.JavaMail.jira@brutus> Date: Mon, 7 Dec 2009 17:25:18 +0000 (UTC) From: "Jonathan Ellis (JIRA)" To: cassandra-commits@incubator.apache.org Subject: [jira] Commented: (CASSANDRA-605) Corruption in CommitLog In-Reply-To: <1450640523.1260055882865.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/CASSANDRA-605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12786996#action_12786996 ] Jonathan Ellis commented on CASSANDRA-605: ------------------------------------------ Chris indicated in IRC that this does look like it only occurs near the end of the commitlog, where fsync hasn't yet guaranteed that data is safe. > Corruption in CommitLog > ----------------------- > > Key: CASSANDRA-605 > URL: https://issues.apache.org/jira/browse/CASSANDRA-605 > Project: Cassandra > Issue Type: Bug > Affects Versions: 0.5 > Reporter: Chris Goffinet > Fix For: 0.5 > > > We are seeing corruption in commit log files when cassandra gets shutdown sometimes. I can attach the commitlogs privately. Here is a stacktrace: > INFO [main] 2009-12-05 14:59:25,946 RecoveryManager.java (line 64) Replaying /mnt/var/cassandra/commitlog/CommitLog-1259972135241.log, /mnt/var/cassandra/commitlog/CommitLog-1260050162791.log, /mnt/var/cassandra/commitlog/CommitLog-1260047770958.log, /mnt/var/cassandra/commitlog/CommitLog-1260052237605.log > ERROR [COMPACTION-POOL:1] 2009-12-05 14:59:37,436 DebuggableThreadPoolExecutor.java (line 120) Error in executor futuretask > java.util.concurrent.ExecutionException: java.lang.NumberFormatException: For input string: "nan" > at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:222) > at java.util.concurrent.FutureTask.get(FutureTask.java:83) > at org.apache.cassandra.concurrent.DebuggableThreadPoolExecutor.afterExecute(DebuggableThreadPoolExecutor.java:112) > at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:888) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) > at java.lang.Thread.run(Thread.java:619) > Caused by: java.lang.NumberFormatException: For input string: "nan" > at sun.misc.FloatingDecimal.readJavaFormatString(FloatingDecimal.java:1224) > at java.lang.Float.valueOf(Float.java:388) > at java.lang.Float.(Float.java:489) > at com.digg.cassandra.db.marshal.FloatStringType.compare(FloatStringType.java:72) > at com.digg.cassandra.db.marshal.FloatStringType.compare(FloatStringType.java:19) > at java.util.concurrent.ConcurrentSkipListMap$ComparableUsingComparator.compareTo(ConcurrentSkipListMap.java:606) > at java.util.concurrent.ConcurrentSkipListMap.doGet(ConcurrentSkipListMap.java:797) > at java.util.concurrent.ConcurrentSkipListMap.get(ConcurrentSkipListMap.java:1640) > at org.apache.cassandra.db.ColumnFamilyStore.removeDeletedStandard(ColumnFamilyStore.java:530) > at org.apache.cassandra.db.ColumnFamilyStore.removeDeleted(ColumnFamilyStore.java:515) > at org.apache.cassandra.io.CompactionIterator.getReduced(CompactionIterator.java:111) > at org.apache.cassandra.io.CompactionIterator.getReduced(CompactionIterator.java:38) > at org.apache.cassandra.utils.ReducingIterator.computeNext(ReducingIterator.java:73) > at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:135) > at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:130) > at org.apache.commons.collections.iterators.FilterIterator.setNextObject(FilterIterator.java:183) > at org.apache.commons.collections.iterators.FilterIterator.hasNext(FilterIterator.java:94) > at org.apache.cassandra.db.ColumnFamilyStore.doFileCompaction(ColumnFamilyStore.java:919) > at org.apache.cassandra.db.ColumnFamilyStore.doFileCompaction(ColumnFamilyStore.java:861) > at org.apache.cassandra.db.ColumnFamilyStore.doCompaction(ColumnFamilyStore.java:663) > at org.apache.cassandra.db.CompactionManager$1.call(CompactionManager.java:180) > at org.apache.cassandra.db.CompactionManager$1.call(CompactionManager.java:177) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) > at java.util.concurrent.FutureTask.run(FutureTask.java:138) > at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) > ... 2 more -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.