From user-return-19328-apmail-cassandra-user-archive=cassandra.apache.org@cassandra.apache.org Mon Aug 1 00:40:54 2011 Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id CF574656C for ; Mon, 1 Aug 2011 00:40:54 +0000 (UTC) Received: (qmail 528 invoked by uid 500); 1 Aug 2011 00:40:52 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 363 invoked by uid 500); 1 Aug 2011 00:40:52 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 355 invoked by uid 99); 1 Aug 2011 00:40:51 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 01 Aug 2011 00:40:51 +0000 X-ASF-Spam-Status: No, hits=0.0 required=5.0 tests=FREEMAIL_FROM,RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: local policy) Received: from [98.139.53.192] (HELO nm9-vm0.bullet.mail.ac4.yahoo.com) (98.139.53.192) by apache.org (qpsmtpd/0.29) with SMTP; Mon, 01 Aug 2011 00:40:42 +0000 Received: from [98.139.52.194] by nm9.bullet.mail.ac4.yahoo.com with NNFMP; 01 Aug 2011 00:40:21 -0000 Received: from [98.139.52.129] by tm7.bullet.mail.ac4.yahoo.com with NNFMP; 01 Aug 2011 00:40:21 -0000 Received: from [127.0.0.1] by omp1012.mail.ac4.yahoo.com with NNFMP; 01 Aug 2011 00:40:21 -0000 X-Yahoo-Newman-Property: ymail-3 X-Yahoo-Newman-Id: 252656.76472.bm@omp1012.mail.ac4.yahoo.com Received: (qmail 22695 invoked by uid 60001); 1 Aug 2011 00:40:20 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1312159220; bh=skcmqAW6gVdGxgHG/jqU7AGecP2yjA7UmcwquOGn+QU=; h=X-YMail-OSG:Received:X-Mailer:References:Message-ID:Date:From:Reply-To:Subject:To:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding; b=nNExiSfwwl6P7A4zLM0c0z0dod+0MuDC/dkZfbsJmwEcOqhDPLOmyVlBbbDpicUb7H6jdDS6rlMeHNww2gcevl3Mfs7scNXYdHngdXbdmpCnq7wtqVqZuhvhdB6YTLIFcvJ87lyO+gTe6i9qyJBvVdOzkVffWlODh1mcjRcxJvI= DomainKey-Signature:a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=X-YMail-OSG:Received:X-Mailer:References:Message-ID:Date:From:Reply-To:Subject:To:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding; b=Wm0c/M/evNrlWqmqXsSJxxJtnC8HETlfBfS0PTPx9ODqF8VoXIypE2EbBWscnLbZt4tpOkKDLXee5LpdGAAE2FLNtdyKnGvJe+Mnjxeyp1X5TmSvDbi3sH9Ntnm0Kvq1nj56Bjb3Ag7lcgepWpVrBDqDOWi8gXNqQ875f4V4oi0=; X-YMail-OSG: D5g1rh0VM1mPRqZCa02AP6ql4_7bj3E626nZpGywhBIn8Pd zaCq38Utd_FDgscg5sHBxy5Kp3iIjrEUNU65TiyQH3xxOmUUghBqL3lMg.a4 pNh6OrdNNidHRaHiyYvpgAPstLN3K69wzC2vGeIZGJwuFAK_Ueh7LaPjJvO. 6rUlcxESxXk6_CI13KYw7gHmJYZZMK1eAh_Y6viYLH1Y2Sz9GAGuQkRj1SbT Nv3ghAaSJ.0CBwOkjnGkzHNzzXv9oR1PHH1kF8h2CNkVFDUhc5wx2UYnHaR5 LNidXYHc37OY9peOY00IiCh7oFwJAb0fFkhbj8x2TCMIAQ0GoYgMOeSbRuAX AVaHE5mX.DlxjORQZOQwh7.h5HL_QVN5xC1BvxxhTteyuGNZbNw_R85RapfJ YcUmCHRmvSMyI Received: from [189.107.249.3] by web130113.mail.mud.yahoo.com via HTTP; Sun, 31 Jul 2011 17:40:20 PDT X-Mailer: YahooMailWebService/0.8.113.313619 References: <1311721389.72350.YahooMailNeo@web130124.mail.mud.yahoo.com> Message-ID: <1312159220.12863.YahooMailNeo@web130113.mail.mud.yahoo.com> Date: Sun, 31 Jul 2011 17:40:20 -0700 (PDT) From: Rafael Almeida Reply-To: Rafael Almeida Subject: Re: "Internal error processing get" during bootstrap To: "user@cassandra.apache.org" In-Reply-To: <1311721389.72350.YahooMailNeo@web130124.mail.mud.yahoo.com> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: quoted-printable I'm going to tell you guys the answers I could find so far.=0A=0AOn=A0Tuesd= ay, July 26, 2011,=A0Rafael Almeida wrote:=0A> I cou= ldn't find much documentation regarding how to make a cluster, but it =0A> = seemed simple enough. At cassandra server A (10.0.0.2) I had seeds: =0A> "l= ocahost". At server B (10.0.0.3) I configured seeds: =0A> "10.0.0.2" and au= to_bootstrap: true. Then I created a keyspace and a =0A> few column familie= s in it.=0A> =0A> I imediately began to add items and to get all these "Int= ernal error =0A> processing get". I found it quite odd, I thought it had to= do with the load =0A> I was putting in, seeing that a few small tests had = worked before. I spent quite =0A> some time debugging, when I finally decid= ed to write this e-mail. I wanted to =0A> double check stuff, so I ran node= tool to see if everything was right. To my =0A> surprise, there was only on= e of the node available. It took a little while for =0A> the other one to s= how up as Joining and then as Normal.=0A> =0A> After I waited that period, = I was able to insert items to the cluster with no =0A> error at all. Is tha= t expected behaviour? What is the recommended way to setup a =0A> cluster? = Should it be done manually. Setting up the machines, creating all =0A> keys= paces and colum families then checking nodetool and waiting for it to get = =0A> stable?=0A=0A=0AThe problem that I was having was mainly because I had= set node A as seed of B=0Aand B as seed of A. I don't know what possessed = me! Regarding the schema=0Aconfiguration. I=A0made a schema file and I load= it using:=0A=0A=A0=A0 =A0cassandra-cli -h localhost --batch < schema-file= =0A=0AIt works alright.=0A=A0=0A> On a side note, sometimes I get "Default = TException" (that seems to =0A> happen when the machine is in a heavier loa= d than usual), commonly retrying the =0A> read or insert right after works = fine.=A0 Is that what's supposed to happen? =0A> Perhaps I should raise som= e timeout somewhere?=0A=0A=0AI still don't get why that error was so freque= nt. At first I was testing it on=A0=0Aworkstations, where people would comp= ile stuff and run all sorts of software. I think=0Athat slowed down things = considerable and the system was having a hard time=A0=0Amanaging connection= s from the application. After I moved it to dedicated computers=0Athose pro= blems ceased to happen.=0A=0A> This is what ./bin/nodetool -h localhost rin= g reports me:=0A> =0A> Address=A0=A0=A0=A0=A0=A0=A0=A0 DC=A0=A0=A0=A0=A0=A0= =A0=A0=A0 Rack=A0=A0=A0=A0=A0=A0=A0 Status State=A0=A0 Load=A0=A0=A0=A0=A0= =A0=A0=A0=A0=A0=A0 Owns=A0=A0=A0 =0A> Token=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0= =A0=A0=A0 =0A> =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0= =A0=A0=A0=A0=A0=A0=A0=A0 =0A> 119105113551249187083945476614048008053=A0=A0= =A0=A0 =0A> 10.0.0.3=A0=A0=A0=A0 datacenter1 rack1=A0=A0=A0=A0=A0=A0 Up=A0= =A0=A0=A0 Normal=A0 3.43 GB=A0=A0=A0=A0=A0=A0=A0=A0 65.90%=A0 =0A> 61078635= 599166706937511052402724559481=A0=A0=A0=A0=A0 =0A> 10.0.0.2 =A0=A0 datacent= er1 rack1=A0=A0=A0=A0=A0=A0 Up=A0=A0=A0=A0 Normal=A0 1.77 GB=A0=A0=A0=A0=A0= =A0=A0=A0 34.10%=A0 =0A> 119105113551249187083945476614048008053=0A> =0A> I= t's still adding stuff. I have no idea why B owns so many more keys than A.= =0A=0A=0AIt happened due to my weird double-seed configuration. Now everyth= ing is fine. I've=0Aexplained how tokens work on a different thread.=0A=0AC= heers,=0ARafael=0A