Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id AC3B7CE2D for ; Tue, 22 May 2012 23:29:10 +0000 (UTC) Received: (qmail 53431 invoked by uid 500); 22 May 2012 23:29:08 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 53405 invoked by uid 500); 22 May 2012 23:29:08 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 53395 invoked by uid 99); 22 May 2012 23:29:08 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 22 May 2012 23:29:08 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of tyler@datastax.com designates 209.85.215.44 as permitted sender) Received: from [209.85.215.44] (HELO mail-lpp01m010-f44.google.com) (209.85.215.44) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 22 May 2012 23:29:03 +0000 Received: by lagv3 with SMTP id v3so5413971lag.31 for ; Tue, 22 May 2012 16:28:41 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type:x-gm-message-state; bh=oNrB/Dr61TEHRkAxzwxaf39T1QG3qU0g00iedFpdDFY=; b=H3lt3W6ImZ8NPMzwk2gOVjZqsA9lXWHXfvZLdPv+IBaI7RQm1OxIRey3qc5rcFWOhT 0mBIfQuQ/nmRUsCDdomdu91po9rSl2YLRmRbv1WFbVduSQcj1qVSNrGC37XAgnEeqOMJ 7defo7GEBFmzqSAIcJ0nxu0azU1Us0ai/TG0NyBx2kmyKYLNOjXUPmB51C4xsTRJhNIP qp6gMCRCACR/2t5ySx4/D7VqZmANefLrQCE3VF1ceISpLSKJZSpCuGwMIzqAbgUv15JZ 1Fa5BLv8j/bsSSRP19Ea9Cz1HrwzIx20iSxZFLN9CyzpDxC0+jtXC3sGwnWPE61p7VCq G0EA== MIME-Version: 1.0 Received: by 10.112.104.100 with SMTP id gd4mr10866941lbb.24.1337729321436; Tue, 22 May 2012 16:28:41 -0700 (PDT) Received: by 10.112.59.132 with HTTP; Tue, 22 May 2012 16:28:41 -0700 (PDT) In-Reply-To: References: Date: Tue, 22 May 2012 18:28:41 -0500 Message-ID: Subject: Re: schema fail to load on some nodes From: Tyler Hobbs To: user@cassandra.apache.org Content-Type: multipart/alternative; boundary=14dae9d6829a0285ea04c0a861d4 X-Gm-Message-State: ALoCoQkJsORt8YtuPVVH2YcTXVhV/xet0rI7QVugO4EX6380DAHjODBhLWhzbp1VgyLyx4XXO1fY X-Virus-Checked: Checked by ClamAV on apache.org --14dae9d6829a0285ea04c0a861d4 Content-Type: text/plain; charset=ISO-8859-1 Looks like this: https://issues.apache.org/jira/browse/CASSANDRA-4269 On Tue, May 22, 2012 at 4:10 PM, Yiming Sun wrote: > Hi, > > We are setting up a 6-node cassandra cluster within one data center. 3 in > rack1 and the other 3 in rack2. The tokens are assigned alternating > between rack 1 and rack 2. There is one seed node in each rack. Below is > the ring: > > r1-node1 DC1 r1 0 (seed) > r2-node1 DC1 r2 28356863910078205288614550619314017621 > r1-node2 DC1 r1 56713727820156410577229101238628035242 > r2-node2 DC1 r2 85070591730234615865843651857942052863 > r1-node3 DC1 r1 113427455640312821154458202477256070484 > r2-node3 DC1 r2 141784319550391026443072753096570088105 > (seed) > > for our schema, we are using NetworkTopologyStrategy, setting DC1 > replication factor to 2. We loaded the schema via cassandra-cli on > r1-node1, and cassandra-cli seemed to have succeeded, but we later > discovered that some nodes didn't load the complete keyspace schema > definition. > > On these nodes, show keyspaces from cassandra-cli would show the keyspace, > but column families are empty. The system.log file also shows the > following stack trace: > > INFO [FlushWriter:4] 2012-05-22 16:56:13,677 Memtable.java (line 307) > Completed flushing > /r1-node2/cassandra-data/system/schema_columnfamilies/system-schema_columnfamilies-hc-6-Data.db > (1428 bytes) > ERROR [MigrationStage:1] 2012-05-22 16:56:13,706 > AbstractCassandraDaemon.java (line 134) Exception in thread > Thread[MigrationStage:1,5,main] > java.lang.RuntimeException: java.nio.charset.MalformedInputException: > Input length = 1 > at > org.apache.cassandra.cql3.ColumnIdentifier.(ColumnIdentifier.java:50) > at > org.apache.cassandra.cql3.CFDefinition.getKeyId(CFDefinition.java:125) > at > org.apache.cassandra.cql3.CFDefinition.(CFDefinition.java:59) > at > org.apache.cassandra.config.CFMetaData.updateCfDef(CFMetaData.java:1278) > at > org.apache.cassandra.config.CFMetaData.keyAlias(CFMetaData.java:221) > at > org.apache.cassandra.config.CFMetaData.fromSchemaNoColumns(CFMetaData.java:1162) > at > org.apache.cassandra.config.CFMetaData.fromSchema(CFMetaData.java:1190) > at > org.apache.cassandra.config.KSMetaData.deserializeColumnFamilies(KSMetaData.java:291) > at > org.apache.cassandra.db.DefsTable.mergeColumnFamilies(DefsTable.java:395) > at > org.apache.cassandra.db.DefsTable.mergeSchema(DefsTable.java:270) > at > org.apache.cassandra.db.DefsTable.mergeRemoteSchema(DefsTable.java:248) > at > org.apache.cassandra.db.DefinitionsUpdateVerbHandler$1.runMayThrow(DefinitionsUpdateVerbHandler.java:48) > at > org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:30) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441) > at > java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) > at java.util.concurrent.FutureTask.run(FutureTask.java:138) > at > java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) > at java.lang.Thread.run(Thread.java:662) > Caused by: java.nio.charset.MalformedInputException: Input length = 1 > at > java.nio.charset.CoderResult.throwException(CoderResult.java:260) > at java.nio.charset.CharsetDecoder.decode(CharsetDecoder.java:781) > at > org.apache.cassandra.utils.ByteBufferUtil.string(ByteBufferUtil.java:163) > at > org.apache.cassandra.utils.ByteBufferUtil.string(ByteBufferUtil.java:120) > at > org.apache.cassandra.cql3.ColumnIdentifier.(ColumnIdentifier.java:46) > ... 18 more > > > Has anyone seen this before? Thanks. > > -- Y. > -- Tyler Hobbs DataStax --14dae9d6829a0285ea04c0a861d4 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Looks like this: https://issues.apache.org/jira/browse/CASSANDRA-4269

On Tue, May 22, 2012 at 4:10 PM, Yiming Sun <yim= ing.sun@gmail.com> wrote:
Hi,

We are setting up a 6= -node cassandra cluster within one data center. =A03 in rack1 and the other= 3 in rack2. =A0The tokens are assigned alternating between rack 1 and rack= 2. =A0There is one seed node in each rack. =A0Below is the ring:

r1-node1 =A0 =A0DC1 =A0 =A0 =A0 =A0 r1 =A0 =A0 =A0= 0 =A0(seed)
r2-node1 =A0 =A0DC1 =A0 =A0 =A0 =A0 r2 =A0 =A0 =A028= 356863910078205288614550619314017621
r1-node2 =A0 =A0DC1 =A0 =A0 = =A0 =A0 r1 =A0 =A0 =A056713727820156410577229101238628035242
r2-node2 =A0 =A0DC1 =A0 =A0 =A0 =A0 r2 =A0 =A0 =A085070591730234615865= 843651857942052863
r1-node3 =A0 =A0DC1 =A0 =A0 =A0 =A0 r1 =A0 =A0= =A0113427455640312821154458202477256070484
r2-node3 =A0 =A0DC1 = =A0 =A0 =A0 =A0 r2 =A0 =A0 =A0141784319550391026443072753096570088105 =A0(s= eed)

for our schema, we are using NetworkTopologyStrat= egy, setting DC1 replication factor to 2. =A0 We loaded the schema via cass= andra-cli on r1-node1, and cassandra-cli seemed to have succeeded, but we l= ater discovered that some nodes didn't load the complete keyspace schem= a definition.

On these nodes, show keyspaces from cassandra-cli would= show the keyspace, but column families are empty. =A0The system.log file a= lso shows the following stack trace:

=A0INFO = [FlushWriter:4] 2012-05-22 16:56:13,677 Memtable.java (line 307) Completed = flushing /r1-node2/cassandra-data/system/schema_columnfamilies/system-schem= a_columnfamilies-hc-6-Data.db (1428 bytes)
ERROR [MigrationStage:1] 2012-05-22 16:56:13,706 AbstractCassandraDaem= on.java (line 134) Exception in thread Thread[MigrationStage:1,5,main]
java.lang.RuntimeException: java.nio.charset.MalformedInputException:= Input length =3D 1
=A0 =A0 =A0 =A0 at org.apache.cassandra.cql3.ColumnIdentifier.<init= >(ColumnIdentifier.java:50)
=A0 =A0 =A0 =A0 at org.apache.cass= andra.cql3.CFDefinition.getKeyId(CFDefinition.java:125)
=A0 =A0 = =A0 =A0 at org.apache.cassandra.cql3.CFDefinition.<init>(CFDefinition= .java:59)
=A0 =A0 =A0 =A0 at org.apache.cassandra.config.CFMetaData.updateCfDef(= CFMetaData.java:1278)
=A0 =A0 =A0 =A0 at org.apache.cassandra.con= fig.CFMetaData.keyAlias(CFMetaData.java:221)
=A0 =A0 =A0 =A0 at o= rg.apache.cassandra.config.CFMetaData.fromSchemaNoColumns(CFMetaData.java:1= 162)
=A0 =A0 =A0 =A0 at org.apache.cassandra.config.CFMetaData.fromSchema(C= FMetaData.java:1190)
=A0 =A0 =A0 =A0 at org.apache.cassandra.conf= ig.KSMetaData.deserializeColumnFamilies(KSMetaData.java:291)
=A0 = =A0 =A0 =A0 at org.apache.cassandra.db.DefsTable.mergeColumnFamilies(DefsTa= ble.java:395)
=A0 =A0 =A0 =A0 at org.apache.cassandra.db.DefsTable.mergeSchema(DefsT= able.java:270)
=A0 =A0 =A0 =A0 at org.apache.cassandra.db.DefsTab= le.mergeRemoteSchema(DefsTable.java:248)
=A0 =A0 =A0 =A0 at org.a= pache.cassandra.db.DefinitionsUpdateVerbHandler$1.runMayThrow(DefinitionsUp= dateVerbHandler.java:48)
=A0 =A0 =A0 =A0 at org.apache.cassandra.utils.WrappedRunnable.run(Wrap= pedRunnable.java:30)
=A0 =A0 =A0 =A0 at java.util.concurrent.Exec= utors$RunnableAdapter.call(Executors.java:441)
=A0 =A0 =A0 =A0 at= java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
=A0 =A0 =A0 =A0 at java.util.concurrent.FutureTask.run(FutureTask.java= :138)
=A0 =A0 =A0 =A0 at java.util.concurrent.ThreadPoolExecutor$= Worker.runTask(ThreadPoolExecutor.java:886)
=A0 =A0 =A0 =A0 at ja= va.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:90= 8)
=A0 =A0 =A0 =A0 at java.lang.Thread.run(Thread.java:662)
Cau= sed by: java.nio.charset.MalformedInputException: Input length =3D 1
<= div>=A0 =A0 =A0 =A0 at java.nio.charset.CoderResult.throwException(CoderRes= ult.java:260)
=A0 =A0 =A0 =A0 at java.nio.charset.CharsetDecoder.decode(CharsetDecod= er.java:781)
=A0 =A0 =A0 =A0 at org.apache.cassandra.utils.ByteBu= fferUtil.string(ByteBufferUtil.java:163)
=A0 =A0 =A0 =A0 at org.a= pache.cassandra.utils.ByteBufferUtil.string(ByteBufferUtil.java:120)
=A0 =A0 =A0 =A0 at org.apache.cassandra.cql3.ColumnIdentifier.<init= >(ColumnIdentifier.java:46)
=A0 =A0 =A0 =A0 ... 18 more
<= /div>


Has anyone seen this before? =A0Tha= nks.

-- Y.



--
Tyler Hobbs
DataStax
<= br> --14dae9d6829a0285ea04c0a861d4--