Return-Path: Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: (qmail 34909 invoked from network); 10 Mar 2011 07:50:13 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 10 Mar 2011 07:50:13 -0000 Received: (qmail 87346 invoked by uid 500); 10 Mar 2011 07:50:10 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 87321 invoked by uid 500); 10 Mar 2011 07:50:10 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 87313 invoked by uid 99); 10 Mar 2011 07:50:10 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 10 Mar 2011 07:50:10 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=5.0 tests=RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: local policy) Received: from [208.113.200.5] (HELO homiemail-a57.g.dreamhost.com) (208.113.200.5) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 10 Mar 2011 07:50:04 +0000 Received: from homiemail-a57.g.dreamhost.com (localhost [127.0.0.1]) by homiemail-a57.g.dreamhost.com (Postfix) with ESMTP id 72CCA20805B for ; Wed, 9 Mar 2011 23:49:43 -0800 (PST) DomainKey-Signature: a=rsa-sha1; c=nofws; d=thelastpickle.com; h=content-type :mime-version:subject:from:in-reply-to:date :content-transfer-encoding:message-id:references:to; q=dns; s= thelastpickle.com; b=oReT23dqZTyiEnPqoWhL9xTeSRBbpI/Jr5gRn6bWQpT /s0I+rEHigwBhYCY9NNcNbwJL7qUXGPKM2UGyqVEYr2xh2an+ZVRzktJtwZARHOM E0JSTWqeKga6Wnx0dozxYaUYEM5iR9/yj4EC/uOBv2dNPxR8uGI56C+GlV3f2nTs = DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=thelastpickle.com; h= content-type:mime-version:subject:from:in-reply-to:date :content-transfer-encoding:message-id:references:to; s= thelastpickle.com; bh=Exva3yWd4yS+JPNgQKALvgpLRB0=; b=zmZn5UJaYi OWLubssk3HdEu3nWx/r4L78FJTSYFHeGyIhfkk+FkBk/xp5cSPk/ij270FT9uDjm eeaV1DZgMvVwjEZGdsaM4v9Nj5nZA/2WAQf/o055WeLeF8p5TU3ASVXWIUXZdunB p8aFRXvWJNGFad0ebr5BvMQlZkAT3VIbk= Received: from [10.0.1.159] (121-73-157-230.cable.telstraclear.net [121.73.157.230]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) (Authenticated sender: aaron@thelastpickle.com) by homiemail-a57.g.dreamhost.com (Postfix) with ESMTPSA id A87BA208058 for ; Wed, 9 Mar 2011 23:49:42 -0800 (PST) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Apple Message framework v1082.1) Subject: Re: Exception when running a clean up From: aaron morton In-Reply-To: Date: Thu, 10 Mar 2011 20:49:39 +1300 Content-Transfer-Encoding: quoted-printable Message-Id: <63DF6806-4005-4B9C-922F-03FB6D626EDA@thelastpickle.com> References: To: user@cassandra.apache.org X-Mailer: Apple Mail (2.1082.1) What version of cassandra are you using and what is the upgrade history = for the cluster? Aaron On 10/03/2011, at 8:24 PM, Stu King wrote: > I am seeing this exception when I am trying to run a cleanup. I want = to decommission the node after the cleanup. >=20 > java.util.concurrent.ExecutionException: java.io.IOError: = java.io.EOFException > at = java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:252) > at java.util.concurrent.FutureTask.get(FutureTask.java:111) > at = org.apache.cassandra.db.CompactionManager.performCleanup(CompactionManager= .java:180) > at = org.apache.cassandra.db.ColumnFamilyStore.forceCleanup(ColumnFamilyStore.j= ava:909) > at = org.apache.cassandra.service.StorageService.forceTableCleanup(StorageServi= ce.java:1127) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at = sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:= 57) > at = sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorIm= pl.java:43) > at java.lang.reflect.Method.invoke(Method.java:616) > at = com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(StandardMBeanIn= trospector.java:111) > at = com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(StandardMBeanIn= trospector.java:45) > at = com.sun.jmx.mbeanserver.MBeanIntrospector.invokeM(MBeanIntrospector.java:2= 26) > at = com.sun.jmx.mbeanserver.PerInterface.invoke(PerInterface.java:138) > at = com.sun.jmx.mbeanserver.MBeanSupport.invoke(MBeanSupport.java:251) > at = com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.invoke(DefaultMBeanS= erverInterceptor.java:857) > at = com.sun.jmx.mbeanserver.JmxMBeanServer.invoke(JmxMBeanServer.java:795) > at = javax.management.remote.rmi.RMIConnectionImpl.doOperation(RMIConnectionImp= l.java:1450) > at = javax.management.remote.rmi.RMIConnectionImpl.access$200(RMIConnectionImpl= .java:90) > at = javax.management.remote.rmi.RMIConnectionImpl$PrivilegedOperation.run(RMIC= onnectionImpl.java:1285) > at = javax.management.remote.rmi.RMIConnectionImpl.doPrivilegedOperation(RMICon= nectionImpl.java:1383) > at = javax.management.remote.rmi.RMIConnectionImpl.invoke(RMIConnectionImpl.jav= a:807) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at = sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:= 57) > at = sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorIm= pl.java:43) > at java.lang.reflect.Method.invoke(Method.java:616) > at = sun.rmi.server.UnicastServerRef.dispatch(UnicastServerRef.java:322) > at sun.rmi.transport.Transport$1.run(Transport.java:177) > at java.security.AccessController.doPrivileged(Native Method) > at sun.rmi.transport.Transport.serviceCall(Transport.java:173) > at = sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:553) > at = sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.jav= a:808) > at = sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java= :667) > at = java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:= 1110) > at = java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java= :603) > at java.lang.Thread.run(Thread.java:636) > Caused by: java.io.IOError: java.io.EOFException > at = org.apache.cassandra.io.sstable.SSTableIdentityIterator.next(SSTableIdenti= tyIterator.java:105) > at = org.apache.cassandra.db.CompactionManager.doCleanupCompaction(CompactionMa= nager.java:418) > at = org.apache.cassandra.db.CompactionManager.access$400(CompactionManager.jav= a:54) > at = org.apache.cassandra.db.CompactionManager$2.call(CompactionManager.java:17= 1) > at = java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) > at java.util.concurrent.FutureTask.run(FutureTask.java:166) > ... 3 more > Caused by: java.io.EOFException > at java.io.RandomAccessFile.readFully(RandomAccessFile.java:416) > at = org.apache.cassandra.utils.FBUtilities.readByteArray(FBUtilities.java:280)= > at = org.apache.cassandra.db.ColumnSerializer.deserialize(ColumnSerializer.java= :76) > at = org.apache.cassandra.db.SuperColumnSerializer.deserialize(SuperColumn.java= :364) > at = org.apache.cassandra.db.SuperColumnSerializer.deserialize(SuperColumn.java= :313) > at = org.apache.cassandra.io.sstable.SSTableIdentityIterator.next(SSTableIdenti= tyIterator.java:101) > ... 8 more