Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 5D6329179 for ; Wed, 23 May 2012 01:06:45 +0000 (UTC) Received: (qmail 71295 invoked by uid 500); 23 May 2012 01:06:43 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 71224 invoked by uid 500); 23 May 2012 01:06:43 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 71215 invoked by uid 99); 23 May 2012 01:06:42 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 23 May 2012 01:06:42 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of yiming.sun@gmail.com designates 209.85.212.172 as permitted sender) Received: from [209.85.212.172] (HELO mail-wi0-f172.google.com) (209.85.212.172) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 23 May 2012 01:06:36 +0000 Received: by wibhj8 with SMTP id hj8so2962503wib.7 for ; Tue, 22 May 2012 18:06:16 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type; bh=podpR4DPqtlijcroYuY2DMmasGwnEJI7HOQjLVCMPAI=; b=nim0pTSRF2py8mY0rL4hHlkh5xXuQZZtYJkrJLGuuZGS2DiIfUQkxV+uM331lVaxjs 3uAQaPRHCkyuPpliTDYf1ViI1fOkiJrGyB7WZU7soiBOl1Hf8atsAiiik9gSLIYu7RZ3 jZ7pFsxiO3VzFLlRf/7BwYA640DYot8OTMMNTU1t5b5Of+uWLOe0pL2kAzIcH2jdLJc4 rn7eA5AWEkE3eDJUW0xPZCBy0xVuaBjW00BeYJPQpdMkJmObSkYQryqCc4ezhOKGRtq2 RhPxrJinRVYKZn+cH99yMADlYJuQhCMCyFP4MFomJfSaPLs1lrctl8Zhjn1Cd4Yj5zGF qlig== Received: by 10.180.83.196 with SMTP id s4mr40133205wiy.15.1337735175878; Tue, 22 May 2012 18:06:15 -0700 (PDT) MIME-Version: 1.0 Received: by 10.216.232.92 with HTTP; Tue, 22 May 2012 18:05:55 -0700 (PDT) In-Reply-To: References: From: Yiming Sun Date: Tue, 22 May 2012 21:05:55 -0400 Message-ID: Subject: Re: schema fail to load on some nodes To: user@cassandra.apache.org Content-Type: multipart/alternative; boundary=f46d04428eeef6380104c0a9bd27 --f46d04428eeef6380104c0a9bd27 Content-Type: text/plain; charset=ISO-8859-1 It indeed looks almost the same, except in our case, we are only using UTF8Type. Hopefully when they release 1.1.1, all will be fixed. Thanks for making me aware of this issue, Tyler. -- Y. On Tue, May 22, 2012 at 7:28 PM, Tyler Hobbs wrote: > Looks like this: https://issues.apache.org/jira/browse/CASSANDRA-4269 > > > On Tue, May 22, 2012 at 4:10 PM, Yiming Sun wrote: > >> Hi, >> >> We are setting up a 6-node cassandra cluster within one data center. 3 >> in rack1 and the other 3 in rack2. The tokens are assigned alternating >> between rack 1 and rack 2. There is one seed node in each rack. Below is >> the ring: >> >> r1-node1 DC1 r1 0 (seed) >> r2-node1 DC1 r2 28356863910078205288614550619314017621 >> r1-node2 DC1 r1 56713727820156410577229101238628035242 >> r2-node2 DC1 r2 85070591730234615865843651857942052863 >> r1-node3 DC1 r1 113427455640312821154458202477256070484 >> r2-node3 DC1 r2 141784319550391026443072753096570088105 >> (seed) >> >> for our schema, we are using NetworkTopologyStrategy, setting DC1 >> replication factor to 2. We loaded the schema via cassandra-cli on >> r1-node1, and cassandra-cli seemed to have succeeded, but we later >> discovered that some nodes didn't load the complete keyspace schema >> definition. >> >> On these nodes, show keyspaces from cassandra-cli would show the >> keyspace, but column families are empty. The system.log file also shows >> the following stack trace: >> >> INFO [FlushWriter:4] 2012-05-22 16:56:13,677 Memtable.java (line 307) >> Completed flushing >> /r1-node2/cassandra-data/system/schema_columnfamilies/system-schema_columnfamilies-hc-6-Data.db >> (1428 bytes) >> ERROR [MigrationStage:1] 2012-05-22 16:56:13,706 >> AbstractCassandraDaemon.java (line 134) Exception in thread >> Thread[MigrationStage:1,5,main] >> java.lang.RuntimeException: java.nio.charset.MalformedInputException: >> Input length = 1 >> at >> org.apache.cassandra.cql3.ColumnIdentifier.(ColumnIdentifier.java:50) >> at >> org.apache.cassandra.cql3.CFDefinition.getKeyId(CFDefinition.java:125) >> at >> org.apache.cassandra.cql3.CFDefinition.(CFDefinition.java:59) >> at >> org.apache.cassandra.config.CFMetaData.updateCfDef(CFMetaData.java:1278) >> at >> org.apache.cassandra.config.CFMetaData.keyAlias(CFMetaData.java:221) >> at >> org.apache.cassandra.config.CFMetaData.fromSchemaNoColumns(CFMetaData.java:1162) >> at >> org.apache.cassandra.config.CFMetaData.fromSchema(CFMetaData.java:1190) >> at >> org.apache.cassandra.config.KSMetaData.deserializeColumnFamilies(KSMetaData.java:291) >> at >> org.apache.cassandra.db.DefsTable.mergeColumnFamilies(DefsTable.java:395) >> at >> org.apache.cassandra.db.DefsTable.mergeSchema(DefsTable.java:270) >> at >> org.apache.cassandra.db.DefsTable.mergeRemoteSchema(DefsTable.java:248) >> at >> org.apache.cassandra.db.DefinitionsUpdateVerbHandler$1.runMayThrow(DefinitionsUpdateVerbHandler.java:48) >> at >> org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:30) >> at >> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441) >> at >> java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) >> at java.util.concurrent.FutureTask.run(FutureTask.java:138) >> at >> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) >> at >> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) >> at java.lang.Thread.run(Thread.java:662) >> Caused by: java.nio.charset.MalformedInputException: Input length = 1 >> at >> java.nio.charset.CoderResult.throwException(CoderResult.java:260) >> at java.nio.charset.CharsetDecoder.decode(CharsetDecoder.java:781) >> at >> org.apache.cassandra.utils.ByteBufferUtil.string(ByteBufferUtil.java:163) >> at >> org.apache.cassandra.utils.ByteBufferUtil.string(ByteBufferUtil.java:120) >> at >> org.apache.cassandra.cql3.ColumnIdentifier.(ColumnIdentifier.java:46) >> ... 18 more >> >> >> Has anyone seen this before? Thanks. >> >> -- Y. >> > > > > -- > Tyler Hobbs > DataStax > > --f46d04428eeef6380104c0a9bd27 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable It indeed looks almost the same, except in our case, we are only using UTF8= Type. =A0Hopefully when they release 1.1.1, all will be fixed. =A0Thanks fo= r making me aware of this issue, Tyler.

-- Y.

On Tue, May 22, 2012 at 7:28 PM, Tyler Hobbs <tyler@datastax.com>= wrote:
Looks like this: https://issues.apache.org/jira/browse/CASSANDRA-42= 69


On Tue, May 22, 2012 at 4:10 PM, Yiming Sun <yiming.sun@gmail.com= > wrote:
Hi,

We are setting up a 6= -node cassandra cluster within one data center. =A03 in rack1 and the other= 3 in rack2. =A0The tokens are assigned alternating between rack 1 and rack= 2. =A0There is one seed node in each rack. =A0Below is the ring:

r1-node1 =A0 =A0DC1 =A0 =A0 =A0 =A0 r1 =A0 =A0 =A0= 0 =A0(seed)
r2-node1 =A0 =A0DC1 =A0 =A0 =A0 =A0 r2 =A0 =A0 =A028= 356863910078205288614550619314017621
r1-node2 =A0 =A0DC1 =A0 =A0 = =A0 =A0 r1 =A0 =A0 =A056713727820156410577229101238628035242
r2-node2 =A0 =A0DC1 =A0 =A0 =A0 =A0 r2 =A0 =A0 =A085070591730234615865= 843651857942052863
r1-node3 =A0 =A0DC1 =A0 =A0 =A0 =A0 r1 =A0 =A0= =A0113427455640312821154458202477256070484
r2-node3 =A0 =A0DC1 = =A0 =A0 =A0 =A0 r2 =A0 =A0 =A0141784319550391026443072753096570088105 =A0(s= eed)

for our schema, we are using NetworkTopologyStrat= egy, setting DC1 replication factor to 2. =A0 We loaded the schema via cass= andra-cli on r1-node1, and cassandra-cli seemed to have succeeded, but we l= ater discovered that some nodes didn't load the complete keyspace schem= a definition.

On these nodes, show keyspaces from cassandra-cli would= show the keyspace, but column families are empty. =A0The system.log file a= lso shows the following stack trace:

=A0INFO = [FlushWriter:4] 2012-05-22 16:56:13,677 Memtable.java (line 307) Completed = flushing /r1-node2/cassandra-data/system/schema_columnfamilies/system-schem= a_columnfamilies-hc-6-Data.db (1428 bytes)
ERROR [MigrationStage:1] 2012-05-22 16:56:13,706 AbstractCassandraDaem= on.java (line 134) Exception in thread Thread[MigrationStage:1,5,main]
java.lang.RuntimeException: java.nio.charset.MalformedInputException:= Input length =3D 1
=A0 =A0 =A0 =A0 at org.apache.cassandra.cql3.ColumnIdentifier.<init= >(ColumnIdentifier.java:50)
=A0 =A0 =A0 =A0 at org.apache.cass= andra.cql3.CFDefinition.getKeyId(CFDefinition.java:125)
=A0 =A0 = =A0 =A0 at org.apache.cassandra.cql3.CFDefinition.<init>(CFDefinition= .java:59)
=A0 =A0 =A0 =A0 at org.apache.cassandra.config.CFMetaData.updateCfDef(= CFMetaData.java:1278)
=A0 =A0 =A0 =A0 at org.apache.cassandra.con= fig.CFMetaData.keyAlias(CFMetaData.java:221)
=A0 =A0 =A0 =A0 at o= rg.apache.cassandra.config.CFMetaData.fromSchemaNoColumns(CFMetaData.java:1= 162)
=A0 =A0 =A0 =A0 at org.apache.cassandra.config.CFMetaData.fromSchema(C= FMetaData.java:1190)
=A0 =A0 =A0 =A0 at org.apache.cassandra.conf= ig.KSMetaData.deserializeColumnFamilies(KSMetaData.java:291)
=A0 = =A0 =A0 =A0 at org.apache.cassandra.db.DefsTable.mergeColumnFamilies(DefsTa= ble.java:395)
=A0 =A0 =A0 =A0 at org.apache.cassandra.db.DefsTable.mergeSchema(DefsT= able.java:270)
=A0 =A0 =A0 =A0 at org.apache.cassandra.db.DefsTab= le.mergeRemoteSchema(DefsTable.java:248)
=A0 =A0 =A0 =A0 at org.a= pache.cassandra.db.DefinitionsUpdateVerbHandler$1.runMayThrow(DefinitionsUp= dateVerbHandler.java:48)
=A0 =A0 =A0 =A0 at org.apache.cassandra.utils.WrappedRunnable.run(Wrap= pedRunnable.java:30)
=A0 =A0 =A0 =A0 at java.util.concurrent.Exec= utors$RunnableAdapter.call(Executors.java:441)
=A0 =A0 =A0 =A0 at= java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
=A0 =A0 =A0 =A0 at java.util.concurrent.FutureTask.run(FutureTask.java= :138)
=A0 =A0 =A0 =A0 at java.util.concurrent.ThreadPoolExecutor$= Worker.runTask(ThreadPoolExecutor.java:886)
=A0 =A0 =A0 =A0 at ja= va.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:90= 8)
=A0 =A0 =A0 =A0 at java.lang.Thread.run(Thread.java:662)
Cau= sed by: java.nio.charset.MalformedInputException: Input length =3D 1
<= div>=A0 =A0 =A0 =A0 at java.nio.charset.CoderResult.throwException(CoderRes= ult.java:260)
=A0 =A0 =A0 =A0 at java.nio.charset.CharsetDecoder.decode(CharsetDecod= er.java:781)
=A0 =A0 =A0 =A0 at org.apache.cassandra.utils.ByteBu= fferUtil.string(ByteBufferUtil.java:163)
=A0 =A0 =A0 =A0 at org.a= pache.cassandra.utils.ByteBufferUtil.string(ByteBufferUtil.java:120)
=A0 =A0 =A0 =A0 at org.apache.cassandra.cql3.ColumnIdentifier.<init= >(ColumnIdentifier.java:46)
=A0 =A0 =A0 =A0 ... 18 more
<= /div>


Has anyone seen this before? =A0Tha= nks.

-- Y.



--
T= yler Hobbs
DataStax
<= br>

--f46d04428eeef6380104c0a9bd27--