Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@cassandra.apache.org
Received-SPF: pass (athena.apache.org: local policy)
DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws;
  s=s1024; d=yahoo.com;
  h=X-YMail-OSG:Received:X-Mailer:Message-ID:Date:From:Reply-To:Subject:To:MIME-Version:Content-Type:Content-Transfer-Encoding;
  b=f1NNgSJQ33ht3VAcJCp8ofBZFIZ0fjFIQEJCM7Kk4UDaPgyTCmMu9LnnJ06T2gMOvz/IDq4IpAxu3c8B1vIsymCnw6RjbpnxkX7GOA4chvjgibKUSBE9uvf1wIAXBjh5YfWRb0vSRclhBzrwSUF7dokmdXG4Q5rl0BrwX0Xnl3Y=;
Message-ID: <1311721389.72350.YahooMailNeo@web130124.mail.mud.yahoo.com>
Date: Tue, 26 Jul 2011 16:03:09 -0700 (PDT)
From: Rafael Almeida <almeidaraf@yahoo.com>
Reply-To: Rafael Almeida <almeidaraf@yahoo.com>
Subject: "Internal error processing get" during bootstrap
To: "user@cassandra.apache.org" <user@cassandra.apache.org>
MIME-Version: 1.0
Content-Type: text/plain; charset=iso-8859-1
Content-Transfer-Encoding: quoted-printable

Hello,=0A=0AI'm evaluating cassandra for use in my system. I could add appr=
oximately 16 million items using a single node. I'm using libcassandra (I c=
an find my way through its code when I need to) to connect to it and I alre=
ady have some infrastructure for handling and adding those items (I was usi=
ng tokio cabinet before).=0A=0AI couldn't find much documentation regarding=
 how to make a cluster, but it seemed simple enough. At cassandra server A =
(10.0.0.2) I had seeds: "locahost". At server B (10.0.0.3) I configured see=
ds: "10.0.0.2" and auto_bootstrap: true. Then I created a keyspace and a fe=
w column families in it.=0A=0AI imediately began to add items and to get al=
l these "Internal error processing get". I found it quite odd, I thought it=
 had to do with the load I was putting in, seeing that a few small tests ha=
d worked before. I spent quite some time debugging, when I finally decided =
to write this e-mail. I wanted to double check stuff, so I ran nodetool to =
see if everything was right. To my surprise, there was only one of the node=
 available. It took a little while for the other one to show up as Joining =
and then as Normal.=0A=0AAfter I waited that period, I was able to insert i=
tems to the cluster with no error at all. Is that expected behaviour? What =
is the recommended way to setup a cluster? Should it be done manually. Sett=
ing up the machines, creating all keyspaces and colum families then checkin=
g nodetool and waiting for it to get stable?=0A=0AOn a side note, sometimes=
 I get "Default TException" (that seems to happen when the machine is in a =
heavier load than usual), commonly retrying the read or insert right after =
works fine.=A0 Is that what's supposed to happen? Perhaps I should raise so=
me timeout somewhere?=0A=0AThis is what ./bin/nodetool -h localhost ring re=
ports me:=0A=0AAddress=A0=A0=A0=A0=A0=A0=A0=A0 DC=A0=A0=A0=A0=A0=A0=A0=A0=
=A0 Rack=A0=A0=A0=A0=A0=A0=A0 Status State=A0=A0 Load=A0=A0=A0=A0=A0=A0=A0=
=A0=A0=A0=A0 Owns=A0=A0=A0 Token=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 =
=0A=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=
=A0=A0=A0=A0 119105113551249187083945476614048008053=A0=A0=A0=A0 =0A10.0.0.=
3=A0=A0=A0=A0 datacenter1 rack1=A0=A0=A0=A0=A0=A0 Up=A0=A0=A0=A0 Normal=A0 =
3.43 GB=A0=A0=A0=A0=A0=A0=A0=A0 65.90%=A0 610786355991667069375110524027245=
59481=A0=A0=A0=A0=A0 =0A10.0.0.2 =A0=A0 datacenter1 rack1=A0=A0=A0=A0=A0=A0=
 Up=A0=A0=A0=A0 Normal=A0 1.77 GB=A0=A0=A0=A0=A0=A0=A0=A0 34.10%=A0 1191051=
13551249187083945476614048008053=0A=0AIt's still adding stuff. I have no id=
ea why B owns so many more keys than A.=0A=0AI'm sorry if what I'm asking i=
s trivial. But I have been having a hard time finding documentation. I've f=
ound a lot of outdated stuff, which was frustrating. I hope you guys have t=
he time to help me out or -- if not -- I hope you can give me good reading =
material.=0A=0AThank you,=0ARafael=0A