From user-return-20018-apmail-cassandra-user-archive=cassandra.apache.org@cassandra.apache.org Fri Aug 19 06:43:23 2011 Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 790557661 for ; Fri, 19 Aug 2011 06:43:23 +0000 (UTC) Received: (qmail 84090 invoked by uid 500); 19 Aug 2011 06:43:20 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 83645 invoked by uid 500); 19 Aug 2011 06:43:09 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 83630 invoked by uid 99); 19 Aug 2011 06:43:01 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 19 Aug 2011 06:43:01 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of ben.coverston@datastax.com designates 209.85.218.44 as permitted sender) Received: from [209.85.218.44] (HELO mail-yi0-f44.google.com) (209.85.218.44) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 19 Aug 2011 06:42:54 +0000 Received: by yie12 with SMTP id 12so2277285yie.31 for ; Thu, 18 Aug 2011 23:42:33 -0700 (PDT) Received: by 10.150.133.11 with SMTP id g11mr1769122ybd.370.1313736153129; Thu, 18 Aug 2011 23:42:33 -0700 (PDT) Received: from Ben-Coverstons-MacBook-Pro.local (c-67-166-71-138.hsd1.ut.comcast.net [67.166.71.138]) by mx.google.com with ESMTPS id b6sm1404676ibg.14.2011.08.18.23.42.31 (version=SSLv3 cipher=OTHER); Thu, 18 Aug 2011 23:42:32 -0700 (PDT) Message-ID: <4E4E05D6.8050506@datastax.com> Date: Fri, 19 Aug 2011 00:42:30 -0600 From: Benjamin Coverston User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:6.0) Gecko/20110812 Thunderbird/6.0 MIME-Version: 1.0 To: user@cassandra.apache.org Subject: Re: Fatal exception in thread Thread[RequestResponseStage...... References: In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit You should run nodetool scrub on the affected nodes. You should probably seriously consider upgrading to the most recent 0.7 release. On Thu Aug 18 22:30:36 2011, Anand Somani wrote: > Hi > > I am using 0.7.4 and am seeing this exception my logs a few times a day, > should I be worried? Or is this just a intermittent network disconnect > > > > ERROR [RequestResponseStage:257] 2011-08-19 03:05:30,706 > AbstractCassandraDaemon.java (line 112) Fatal exception in thread > Thread[RequestResponseStage:257,5,main] > java.io.IOError: java.io.EOFException > at > org.apache.cassandra.io.util.ColumnIterator.deserializeNext(ColumnSortedMap.java:246) > at > org.apache.cassandra.io.util.ColumnIterator.next(ColumnSortedMap.java:262) > at > org.apache.cassandra.io.util.ColumnIterator.next(ColumnSortedMap.java:223) > at > java.util.concurrent.ConcurrentSkipListMap.buildFromSorted(ConcurrentSkipListMap.java:1493) > at > java.util.concurrent.ConcurrentSkipListMap.(ConcurrentSkipListMap.java:1443) > at > org.apache.cassandra.db.SuperColumnSerializer.deserialize(SuperColumn.java:363) > at > org.apache.cassandra.db.SuperColumnSerializer.deserialize(SuperColumn.java:311) > at > org.apache.cassandra.db.ColumnFamilySerializer.deserializeColumns(ColumnFamilySerializer.java:129) > at > org.apache.cassandra.db.ColumnFamilySerializer.deserialize(ColumnFamilySerializer.java:120) > at org.apache.cassandra.db.RowSerializer.deserialize(Row.java:73) > at > org.apache.cassandra.db.ReadResponseSerializer.deserialize(ReadResponse.java:112) > at > org.apache.cassandra.db.ReadResponseSerializer.deserialize(ReadResponse.java:82) > at > org.apache.cassandra.service.AbstractRowResolver.preprocess(AbstractRowResolver.java:64) > at > org.apache.cassandra.service.AsyncRepairCallback.response(AsyncRepairCallback.java:45) > at > org.apache.cassandra.net.ResponseVerbHandler.doVerb(ResponseVerbHandler.java:49) > at > org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:72) > at > java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) > at java.lang.Thread.run(Thread.java:662) > Caused by: java.io.EOFException > at java.io.DataInputStream.readByte(DataInputStream.java:250) > at > org.apache.cassandra.utils.ByteBufferUtil.readShortLength(ByteBufferUtil.java:278) > at > org.apache.cassandra.utils.ByteBufferUtil.readWithShortLength(ByteBufferUtil.java:289) > at > org.apache.cassandra.db.ColumnSerializer.deserialize(ColumnSerializer.java:66) > at > org.apache.cassandra.io.util.ColumnIterator.deserializeNext(ColumnSortedMap.java:242) > ... 18 more -- Ben Coverston Director of Operations DataStax -- The Apache Cassandra Company http://www.datastax.com/