Return-Path: Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: (qmail 14617 invoked from network); 22 Dec 2010 21:43:02 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 22 Dec 2010 21:43:02 -0000 Received: (qmail 73318 invoked by uid 500); 22 Dec 2010 21:43:00 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 73261 invoked by uid 500); 22 Dec 2010 21:43:00 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 73253 invoked by uid 99); 22 Dec 2010 21:43:00 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 22 Dec 2010 21:43:00 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=10.0 tests=FREEMAIL_FROM,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of jbellis@gmail.com designates 209.85.160.44 as permitted sender) Received: from [209.85.160.44] (HELO mail-pw0-f44.google.com) (209.85.160.44) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 22 Dec 2010 21:42:55 +0000 Received: by pwi7 with SMTP id 7so452531pwi.31 for ; Wed, 22 Dec 2010 13:42:34 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:received:in-reply-to :references:date:message-id:subject:from:to:content-type :content-transfer-encoding; bh=PLb+B1iWei655NRjy+Kezy74lrBU1OvkmxIAFNvYZME=; b=ovOEJXYHmuxywjK4HOBcjaL+D9SbcyPMaG2UgnN7ox1prFeLwYEuDHFMMYYouc9Z9z A7vQE/6yv2uEYulJSGN74OR86SWIB27Xhm6taPlaCleyVGupeugu/QrG25IE2GJJx2wJ sdO/X8H5+fgblzQLvmburWale36YzbNh2vL2g= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type:content-transfer-encoding; b=Ubo9mqSH0+ddToeLzrX3GKbH11ojGRLUBnU5xLrjJSrcSaYQqvp8QSgRTSQ9kz9REW LOp3qSxKpzPTAHLooky+IL1PHz6I64yxzN6JL6rXZpXCZNKGXjkCSNT14K2TMOw5r2Ff kHHeG84I0c/NP5CPhCzuibAiOYdoss+xCxaW0= MIME-Version: 1.0 Received: by 10.143.41.7 with SMTP id t7mr6008431wfj.102.1293054154374; Wed, 22 Dec 2010 13:42:34 -0800 (PST) Received: by 10.142.43.19 with HTTP; Wed, 22 Dec 2010 13:42:34 -0800 (PST) In-Reply-To: References: Date: Wed, 22 Dec 2010 15:42:34 -0600 Message-ID: Subject: Re: cli 'list' command not returning all data, get_range_slices bug? From: Jonathan Ellis To: user Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable what do you see in the logs during the list command at debug level? On Tue, Dec 21, 2010 at 5:01 PM, mike dooley wrote: > hi, > i am using=A0version 0.7-rc2 and=A0pelops-c642967 from java. =A0when i tr= y > to export all the data in a column family i don't get all of the data tha= t > was inserted. =A0i suspect that this points to an underlying problem with > the=A0get_range_slices method. > i can reproduce the problem just using the command line interface > as follows: > 1) create a 2 node cluster using the default cassandra.yml with these > changes: > * set the initial token for the 1st node: > initial_token: 0 > * set the initial token for the 2nd node: > initial_token:=A085070591730234615865843651857942052864 > *comment out: > #listen_address: localhost > #rpc_address: localhost > *set the seeds (change ip's) > seeds: > =A0=A0 - 17.224.109.80 > =A0=A0 - 17.224.109.81 > 2) start both nodes > 3) put these commands in a file called schema.txt > create keyspace Test with replication_factor =3D 1 and placement_strategy= =3D > 'org.apache.cassandra.locator.SimpleStrategy'; > use Test; > create column family Configs with column_type =3D 'Standard' and comparat= or =3D > 'UTF8Type'; > and load them with the command line tool like this: > ./bin/cassandra-cli --host=A017.224.109.80 < schema.txt > 4) put these commands in a file called config.txt > use Test; > set Configs['row-a']['key-a'] =3D '1'; > set Configs['row-a']['key-b'] =3D '2'; > set Configs['row-a']['key-c'] =3D '3'; > set Configs['row-b']['key-a'] =3D '4'; > set Configs['row-b']['key-b'] =3D '5'; > set Configs['row-b']['key-c'] =3D '6'; > set Configs['row-c']['key-a'] =3D '7'; > set Configs['row-c']['key-b'] =3D '8'; > set Configs['row-c']['key-c'] =3D '9'; > and load them with the command line tool like this: > ./bin/cassandra-cli --host=A017.224.109.80 < config.txt > 5) =A0now start the command line tool and try to list the Configs column > family: > ./bin/cassandra-cli --host=A017.224.109.80 > Connected to: "Test Cluster" on 17.224.109.80/9160 > Welcome to cassandra CLI. > Type 'help;' or '?' for help. Type 'quit;' or 'exit;' to quit. > [default@unknown] use Test; > Authenticated to keyspace: Test > [default@Test] list Configs; > Using default limit of 100 > 0 Row Returned. > [default@Test] get Configs['row-a']; > =3D> (column=3Dkey-a, value=3D31, timestamp=3D1292970451049000) > =3D> (column=3Dkey-b, value=3D32, timestamp=3D1292970451099000) > =3D> (column=3Dkey-c, value=3D33, timestamp=3D1292970451104000) > Returned 3 results. > [default@Test] get Configs['row-b']; > =3D> (column=3Dkey-a, value=3D34, timestamp=3D1292970451108000) > =3D> (column=3Dkey-b, value=3D35, timestamp=3D1292970451111000) > =3D> (column=3Dkey-c, value=3D36, timestamp=3D1292970451116000) > Returned 3 results. > [default@Test] get Configs['row-c']; > =3D> (column=3Dkey-a, value=3D37, timestamp=3D1292970451120000) > =3D> (column=3Dkey-b, value=3D38, timestamp=3D1292970451123000) > =3D> (column=3Dkey-c, value=3D39, timestamp=3D1292970451128000) > Returned 3 results. > note: that the 'list Configs' command doesn't return any results, > but when you 'get' a particular row the data is there. > note: when only using a single node everything works as > expected > note: that if you try to combine schema.txt and config.txt and > load all at once the first data point fails to load and the following > error shows up in the 2nd node's logs: > =A0INFO [FlushWriter:1] 2010-12-21 12:30:25,701 Memtable.java (line 155) > Writing Memtable-Schema@390276053(2184 bytes, 3 operations) > ERROR [MutationStage:1] 2010-12-21 12:30:25,718 RowMutationVerbHandler.ja= va > (line 83) Error in row mutation > org.apache.cassandra.db.UnserializableColumnFamilyException: Couldn't fin= d > cfId=3D1000 > =A0=A0 =A0 =A0 =A0at > org.apache.cassandra.db.ColumnFamilySerializer.deserialize(ColumnFamilySe= rializer.java:117) > =A0=A0 =A0 =A0 =A0at > org.apache.cassandra.db.RowMutationSerializer.defreezeTheMaps(RowMutation= .java:383) > =A0=A0 =A0 =A0 =A0at > org.apache.cassandra.db.RowMutationSerializer.deserialize(RowMutation.jav= a:393) > =A0=A0 =A0 =A0 =A0at > org.apache.cassandra.db.RowMutationSerializer.deserialize(RowMutation.jav= a:351) > =A0=A0 =A0 =A0 =A0at > org.apache.cassandra.db.RowMutationVerbHandler.doVerb(RowMutationVerbHand= ler.java:52) > =A0=A0 =A0 =A0 =A0at > org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java= :63) > =A0=A0 =A0 =A0 =A0at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java= :1110) > =A0=A0 =A0 =A0 =A0at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.jav= a:603) > =A0=A0 =A0 =A0 =A0at java.lang.Thread.run(Thread.java:636) > =A0INFO [FlushWriter:1] 2010-12-21 12:30:25,925 Memtable.java (line 162) > Completed flushing /var/lib/cassandra/data/system/Schema-e-1-Data.db (247= 2 > byte > has anyone else seen anything similar or is there something that i'm > missing? > thanks, > -mike > --=20 Jonathan Ellis Project Chair, Apache Cassandra co-founder of Riptano, the source for professional Cassandra support http://riptano.com