Return-Path: Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: (qmail 37332 invoked from network); 15 Feb 2011 16:27:39 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 15 Feb 2011 16:27:39 -0000 Received: (qmail 67665 invoked by uid 500); 15 Feb 2011 16:27:37 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 67583 invoked by uid 500); 15 Feb 2011 16:27:34 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 67575 invoked by uid 99); 15 Feb 2011 16:27:34 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 15 Feb 2011 16:27:34 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=FREEMAIL_FROM,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of jakers@gmail.com designates 209.85.213.44 as permitted sender) Received: from [209.85.213.44] (HELO mail-yw0-f44.google.com) (209.85.213.44) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 15 Feb 2011 16:27:29 +0000 Received: by ywk9 with SMTP id 9so172490ywk.31 for ; Tue, 15 Feb 2011 08:27:08 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:in-reply-to:references:date :message-id:subject:from:to:content-type; bh=4y6qbJm6f5YdOx2u0IrkOMisSGKkZX2Zbu2g6q2iSxc=; b=M+rVCErEnmxoUJoMXgmhacMncftxbyvxodctR536HpyzpekgfQfFDXoDxr7nDCyfTo uR3NieHagvPBqJcg2M970bf4KIK/1vPCccf+GMXhFpit0vw68aBexav7bz0Vrvt/Bjc7 +8dr/g45hzRMivEA/b74hjscQReiPfFb3NIQA= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; b=ZHV8IU3WK+otiJT4TfqaxoZRQWhC0BJoLDgDYla4kGksRXiOAl4b6OCtLDKajOCAbS 2s9nytrJf8M1qnzBvCooEl8oO7zUJMc9eJhaQ+twbNAk/Vlb5xwEyTrPOSx/vyPXlq3I 4nHHG3If/tWCCxWA0mJW+2fkxS26Q9uSOfMeM= MIME-Version: 1.0 Received: by 10.42.172.199 with SMTP id o7mr778496icz.381.1297787228384; Tue, 15 Feb 2011 08:27:08 -0800 (PST) Received: by 10.42.140.8 with HTTP; Tue, 15 Feb 2011 08:27:08 -0800 (PST) In-Reply-To: <4D5AA409.8070207@trioptima.com> References: <4D5AA409.8070207@trioptima.com> Date: Tue, 15 Feb 2011 11:27:08 -0500 Message-ID: Subject: Re: Possible EOFException regression in 0.7.1 From: Jake Luciani To: user@cassandra.apache.org Content-Type: multipart/alternative; boundary=90e6ba6e8650bded81049c54a25c --90e6ba6e8650bded81049c54a25c Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Have you made any changes to the cassandra config? 2011/2/15 Jonas Borgstr=F6m > Hi all, > > While testing the new 0.7.1 release I got the following exception: > > ERROR [ReadStage:11] 2011-02-15 16:39:18,105 > DebuggableThreadPoolExecutor.java (line 103) Error in ThreadPoolExecutor > java.io.IOError: java.io.EOFException > at > > org.apache.cassandra.db.columniterator.SSTableNamesIterator.(SSTabl= eNamesIterator.java:75) > at > > org.apache.cassandra.db.filter.NamesQueryFilter.getSSTableColumnIterator(= NamesQueryFilter.java:59) > at > > org.apache.cassandra.db.filter.QueryFilter.getSSTableColumnIterator(Query= Filter.java:80) > at > > org.apache.cassandra.db.ColumnFamilyStore.getTopLevelColumns(ColumnFamily= Store.java:1274) > at > > org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilySto= re.java:1166) > at > > org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilySto= re.java:1095) > at org.apache.cassandra.db.Table.getRow(Table.java:384) > at > > org.apache.cassandra.db.SliceByNamesReadCommand.getRow(SliceByNamesReadCo= mmand.java:60) > at > > org.apache.cassandra.service.StorageProxy$LocalReadRunnable.runMayThrow(S= torageProxy.java:473) > at > org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:30) > at > > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java= :1110) > at > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.jav= a:603) > at java.lang.Thread.run(Thread.java:636) > Caused by: java.io.EOFException > at java.io.DataInputStream.readInt(DataInputStream.java:392) > at > > org.apache.cassandra.utils.BloomFilterSerializer.deserialize(BloomFilterS= erializer.java:48) > at > > org.apache.cassandra.utils.BloomFilterSerializer.deserialize(BloomFilterS= erializer.java:30) > at > > org.apache.cassandra.io.sstable.IndexHelper.defreezeBloomFilter(IndexHelp= er.java:108) > at > > org.apache.cassandra.db.columniterator.SSTableNamesIterator.read(SSTableN= amesIterator.java:106) > at > > org.apache.cassandra.db.columniterator.SSTableNamesIterator.(SSTabl= eNamesIterator.java:71) > ... 12 more > > I'm able reliably reproduce this using the following one node cluster: > - apache-cassandra-0.7.1-bin.tar.gz > - Fedora 14 > - java version "1.6.0_20". > OpenJDK 64-Bit Server VM (build 19.0-b09, mixed mode) > - Default cassandra.yaml > - cassandra-env.sh: MAX_HEAP_SIZE=3D"1G"; HEAP_NEWSIZE=3D"200M" > > cassandra-cli initialization: > - create keyspace foo; > - use foo; > - create column family datasets; > > $ python dataset_check.py (attached) > Inserting row 0 of 10 > Inserting row 1 of 10 > Inserting row 2 of 10 > Inserting row 3 of 10 > Inserting row 4 of 10 > Inserting row 5 of 10 > Inserting row 6 of 10 > Inserting row 7 of 10 > Inserting row 8 of 10 > Inserting row 9 of 10 > Attempting to fetch key 0 > Traceback (most recent call last): > ... > pycassa.pool.MaximumRetryException: Retried 6 times > > After this I have 6 EOFExceptions in system.log. > Running "get datasets[0]['name'];" using cassandra-cli also triggers the > same exception. > I've not been able to reproduce this with cassandra 0.7.0. > > Regards, > Jonas > > > --90e6ba6e8650bded81049c54a25c Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Have you made any changes to the cassandra config?

2011/2/15 Jonas Borgstr=F6m <jonas.borgstrom@trioptima.com>
Hi all,

While testing the new 0.7.1 release I got the following exception:

ERROR [ReadStage:11] 2011-02-15 16:39:18,105
DebuggableThreadPoolExecutor.java (line 103) Error in ThreadPoolExecutor java.io.IOError: java.io.EOFException
=A0 =A0 =A0 =A0at
org.apache.cassandra.db.columniterator.SSTableNamesIterator.<init>(SS= TableNamesIterator.java:75)
=A0 =A0 =A0 =A0at
org.apache.cassandra.db.filter.NamesQueryFilter.getSSTableColumnIterator(Na= mesQueryFilter.java:59)
=A0 =A0 =A0 =A0at
org.apache.cassandra.db.filter.QueryFilter.getSSTableColumnIterator(QueryFi= lter.java:80)
=A0 =A0 =A0 =A0at
org.apache.cassandra.db.ColumnFamilyStore.getTopLevelColumns(ColumnFamilySt= ore.java:1274)
=A0 =A0 =A0 =A0at
org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilyStore= .java:1166)
=A0 =A0 =A0 =A0at
org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilyStore= .java:1095)
=A0 =A0 =A0 =A0at org.apache.cassandra.db.Table.getRow(Table.java:384)
=A0 =A0 =A0 =A0at
org.apache.cassandra.db.SliceByNamesReadCommand.getRow(SliceByNamesReadComm= and.java:60)
=A0 =A0 =A0 =A0at
org.apache.cassandra.service.StorageProxy$LocalReadRunnable.runMayThrow(Sto= rageProxy.java:473)
=A0 =A0 =A0 =A0at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRu= nnable.java:30)
=A0 =A0 =A0 =A0at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1= 110)
=A0 =A0 =A0 =A0at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:= 603)
=A0 =A0 =A0 =A0at java.lang.Thread.run(Thread.java:636)
Caused by: java.io.EOFException
=A0 =A0 =A0 =A0at java.io.DataInputStream.readInt(DataInputStream.java:392= )
=A0 =A0 =A0 =A0at
org.apache.cassandra.utils.BloomFilterSerializer.deserialize(BloomFilterSer= ializer.java:48)
=A0 =A0 =A0 =A0at
org.apache.cassandra.utils.BloomFilterSerializer.deserialize(BloomFilterSer= ializer.java:30)
=A0 =A0 =A0 =A0at
org.apache.cassandra.io.sstable.IndexHelper.defreezeBloomFilter(IndexHelper= .java:108)
=A0 =A0 =A0 =A0at
org.apache.cassandra.db.columniterator.SSTableNamesIterator.read(SSTableNam= esIterator.java:106)
=A0 =A0 =A0 =A0at
org.apache.cassandra.db.columniterator.SSTableNamesIterator.<init>(SS= TableNamesIterator.java:71)
=A0 =A0 =A0 =A0... 12 more

I'm able reliably reproduce this using the following one node cluster:<= br> - apache-cassandra-0.7.1-bin.tar.gz
- Fedora 14
- java version "1.6.0_20".
=A0OpenJDK 64-Bit Server VM (build 19.0-b09, mixed mode)
- Default cassandra.yaml
- cassandra-env.sh: MAX_HEAP_SIZE=3D"1G"; HEAP_NEWSIZE=3D"20= 0M"

cassandra-cli initialization:
- create keyspace foo;
- use foo;
- create column family datasets;

$ python dataset_check.py (attached)
Inserting row 0 of 10
Inserting row 1 of 10
Inserting row 2 of 10
Inserting row 3 of 10
Inserting row 4 of 10
Inserting row 5 of 10
Inserting row 6 of 10
Inserting row 7 of 10
Inserting row 8 of 10
Inserting row 9 of 10
Attempting to fetch key 0
Traceback (most recent call last):
...
pycassa.pool.MaximumRetryException: Retried 6 times

After this I have 6 EOFExceptions in system.log.
Running "get datasets[0]['name'];" using cassandra-cli al= so triggers the
same exception.
I've not been able to reproduce this with cassandra 0.7.0.

Regards,
Jonas



--90e6ba6e8650bded81049c54a25c--