Return-Path: X-Original-To: apmail-cassandra-commits-archive@www.apache.org Delivered-To: apmail-cassandra-commits-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 647E77E67 for ; Sat, 30 Jul 2011 04:16:55 +0000 (UTC) Received: (qmail 86651 invoked by uid 500); 30 Jul 2011 04:16:51 -0000 Delivered-To: apmail-cassandra-commits-archive@cassandra.apache.org Received: (qmail 85989 invoked by uid 500); 30 Jul 2011 04:16:42 -0000 Mailing-List: contact commits-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@cassandra.apache.org Delivered-To: mailing list commits@cassandra.apache.org Received: (qmail 85894 invoked by uid 99); 30 Jul 2011 04:16:36 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 30 Jul 2011 04:16:36 +0000 X-ASF-Spam-Status: No, hits=-2001.2 required=5.0 tests=ALL_TRUSTED,RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 30 Jul 2011 04:16:33 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id EEE9F9499C for ; Sat, 30 Jul 2011 04:16:11 +0000 (UTC) Date: Sat, 30 Jul 2011 04:16:11 +0000 (UTC) From: "Jonathan Ellis (JIRA)" To: commits@cassandra.apache.org Message-ID: <1700157027.20567.1311999371975.JavaMail.tomcat@hel.zones.apache.org> In-Reply-To: <2013213504.20544.1311997689634.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Commented] (CASSANDRA-2973) fatal errrors after nodetool cleanup MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/CASSANDRA-2973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13073126#comment-13073126 ] Jonathan Ellis commented on CASSANDRA-2973: ------------------------------------------- Is it reproducible? If not, it's quite possible that it's transient hardware-caused corruption. > fatal errrors after nodetool cleanup > ------------------------------------ > > Key: CASSANDRA-2973 > URL: https://issues.apache.org/jira/browse/CASSANDRA-2973 > Project: Cassandra > Issue Type: Bug > Affects Versions: 0.8.1 > Reporter: Wojciech Meler > > after adding nodes to cluster & running cleanup I get scaring exceptions in log: > 2011-07-30 00:00:05:506 CEST ERROR [ReadStage:2335][org.apache.cassandra.service.AbstractCassandraDaemon] Fatal exception in thread Thread[ReadStage:2335,5,main] > java.io.IOError: java.io.IOException: mmap segment underflow; remaining is 4394 but 60165 requested > at org.apache.cassandra.db.columniterator.IndexedSliceReader.(IndexedSliceReader.java:80) > at org.apache.cassandra.db.columniterator.SSTableSliceIterator.createReader(SSTableSliceIterator.java:91) > at org.apache.cassandra.db.columniterator.SSTableSliceIterator.(SSTableSliceIterator.java:67) > at org.apache.cassandra.db.filter.SliceQueryFilter.getSSTableColumnIterator(SliceQueryFilter.java:66) > at org.apache.cassandra.db.filter.QueryFilter.getSSTableColumnIterator(QueryFilter.java:80) > at org.apache.cassandra.db.ColumnFamilyStore.getTopLevelColumns(ColumnFamilyStore.java:1292) > at org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilyStore.java:1189) > at org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilyStore.java:1146) > at org.apache.cassandra.db.Table.getRow(Table.java:385) > at org.apache.cassandra.db.SliceFromReadCommand.getRow(SliceFromReadCommand.java:61) > at org.apache.cassandra.db.ReadVerbHandler.doVerb(ReadVerbHandler.java:69) > at org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:72) > at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) > at java.lang.Thread.run(Thread.java:662) > Caused by: java.io.IOException: mmap segment underflow; remaining is 4394 but 60165 requested > at org.apache.cassandra.io.util.MappedFileDataInput.readBytes(MappedFileDataInput.java:117) > at org.apache.cassandra.utils.ByteBufferUtil.read(ByteBufferUtil.java:389) > at org.apache.cassandra.utils.ByteBufferUtil.readWithShortLength(ByteBufferUtil.java:368) > at org.apache.cassandra.io.sstable.IndexHelper$IndexInfo.deserialize(IndexHelper.java:194) > at org.apache.cassandra.io.sstable.IndexHelper.deserializeIndex(IndexHelper.java:83) > at org.apache.cassandra.db.columniterator.IndexedSliceReader.(IndexedSliceReader.java:73) > ... 14 more > exceptions disappeared after running scrub -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira