Return-Path: Delivered-To: apmail-incubator-cassandra-user-archive@minotaur.apache.org Received: (qmail 14604 invoked from network); 3 Mar 2010 06:02:18 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 3 Mar 2010 06:02:18 -0000 Received: (qmail 76777 invoked by uid 500); 3 Mar 2010 06:02:11 -0000 Delivered-To: apmail-incubator-cassandra-user-archive@incubator.apache.org Received: (qmail 76753 invoked by uid 500); 3 Mar 2010 06:02:11 -0000 Mailing-List: contact cassandra-user-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: cassandra-user@incubator.apache.org Delivered-To: mailing list cassandra-user@incubator.apache.org Received: (qmail 76745 invoked by uid 99); 3 Mar 2010 06:02:11 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 03 Mar 2010 06:02:11 +0000 X-ASF-Spam-Status: No, hits=4.2 required=10.0 tests=HTML_MESSAGE,NO_RDNS_DOTCOM_HELO,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (nike.apache.org: local policy) Received: from [216.145.54.171] (HELO mrout1.yahoo.com) (216.145.54.171) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 03 Mar 2010 06:02:00 +0000 Received: from sp1-ex07cas03.ds.corp.yahoo.com (sp1-ex07cas03.ds.corp.yahoo.com [216.252.116.151] (may be forged)) by mrout1.yahoo.com (8.13.6/8.13.6/y.out) with ESMTP id o235xwtd003775 for ; Tue, 2 Mar 2010 21:59:59 -0800 (PST) DomainKey-Signature: a=rsa-sha1; s=serpent; d=yahoo-inc.com; c=nofws; q=dns; h=received:from:to:date:subject:thread-topic:thread-index: message-id:in-reply-to:accept-language:content-language: x-ms-has-attach:x-ms-tnef-correlator:acceptlanguage:content-type:mime-version; b=Sxr7tBVmEctSq5sD/C8ihVGmRzlUEWNx6Ko+UjYGd/mhsRytyzzWpCvhAhxhEvHv Received: from SP1-EX07VS01.ds.corp.yahoo.com ([216.252.116.139]) by sp1-ex07cas03.ds.corp.yahoo.com ([216.252.116.151]) with mapi; Tue, 2 Mar 2010 21:59:57 -0800 From: Brian Frank Cooper To: "cassandra-user@incubator.apache.org" Date: Tue, 2 Mar 2010 21:59:56 -0800 Subject: Re: Connect during bootstrapping? Thread-Topic: Connect during bootstrapping? Thread-Index: Acq6RkyhxM6XCe3UTnazq4csuQTYIQATyTW8AABTmD0= Message-ID: In-Reply-To: Accept-Language: en-US Content-Language: en X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US Content-Type: multipart/alternative; boundary="_000_C7B33ADC980Acooperbyahooinccom_" MIME-Version: 1.0 X-Virus-Checked: Checked by ClamAV on apache.org --_000_C7B33ADC980Acooperbyahooinccom_ Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable Also, the other nodes say: INFO - Node /98.137.30.39 is now part of the cluster INFO - InetAddress /98.137.30.39 is now UP INFO - Node /98.137.30.39 state jump to leaving (.39 is the new node) Does the "jump to leaving" mean that they think .39 has left the cluster? .= 39 thinks it is still up... Thanks... brian On 3/2/10 9:50 PM, "Brian Frank Cooper" wrote: Thanks for the note. Can you help me with something else? I can't seem to get any data to transf= er during bootstrapping...I must be doing something wrong. Here is what I did: I took 0.6.0-beta2, loaded 2 machines with 60-70GB each= . Then I started a third node, with AutoBootstrap true. The node claims it = is bootstrapping: INFO - Auto DiskAccessMode determined to be mmap INFO - Saved Token not found. Using Rb0mePN3PheW3haA INFO - Creating new commitlog segment /home/cooperb/cassandra/commitlog/Com= mitLog-1267594407761.log INFO - Starting up server gossip INFO - Joining: getting load information INFO - Sleeping 90000 ms to wait for load information... INFO - Node /98.137.30.37 is now part of the cluster INFO - Node /98.137.30.38 is now part of the cluster INFO - InetAddress /98.137.30.37 is now UP INFO - InetAddress /98.137.30.38 is now UP INFO - Joining: getting bootstrap token INFO - New token will be user148315419 to assume load from /98.137.30.38 INFO - Joining: sleeping 30000 for pending range setup INFO - Bootstrapping But when I run nodetool streams, no streams are transferring: Mode: Bootstrapping Not sending any streams. Not receiving any streams. And it doesn't look like the node is getting any data. Any ideas? Thanks for the help... Brian On 3/2/10 12:22 PM, "Jonathan Ellis" wrote: On Tue, Mar 2, 2010 at 1:54 PM, Brian Frank Cooper wrote: > Hi folks, > > I'm running 0.5 and I had 2 nodes up and running, then added a 3rd node i= n > bootstrap mode. I understand from other discussion list threads that the = new > node doesn't serve reads while it is bootstrapping, but does that mean it > won't connect at all? it doesn't start the thrift listener until it is bootstrapped, so yes. (you can tell when it's bootstrapped by when it appears in nodeprobe ring. 0.6 also adds bootstrap progress reporting via jmx.) > When I try to connect from my java client, or > cassandra-cli, I get the exception below. Is it the expected behavior? > (Also, cassandra-cli says "Connected to xxx.yahoo.com" even though it isn= 't > really connected...) This is fixed in https://issues.apache.org/jira/browse/CASSANDRA-807 for 0.6, fwiw. -Jonathan -- Brian Cooper Principal Research Scientist Yahoo! Research --_000_C7B33ADC980Acooperbyahooinccom_ Content-Type: text/html; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable Re: Connect during bootstrapping? Also, the other nodes say:

INFO - Node /98.137.30.39 is now part of the cluster
INFO - InetAddress /98.137.30.39 is now UP
INFO - Node /98.137.30.39 state jump to leaving

(.39 is the new node)

Does the “jump to leaving” mean that they think .39 has left th= e cluster? .39 thinks it is still up...

Thanks...

brian


On 3/2/10 9:50 PM, "Brian Frank Cooper" <cooperb@yahoo-inc.com> wrote:

Thanks for the note.

Can you help me with something else? I can’t seem to get any data to = transfer during bootstrapping...I must be doing something wrong.

Here is what I did: I took 0.6.0-beta2, loaded 2 machines with 60-70GB each= . Then I started a third node, with AutoBootstrap true. The node claims it = is bootstrapping:

INFO - Auto DiskAccessMode determined to be mmap
INFO - Saved Token not found. Using Rb0mePN3PheW3haA
INFO - Creating new commitlog segment /home/cooperb/cassandra/commitlog/Com= mitLog-1267594407761.log
INFO - Starting up server gossip
INFO - Joining: getting load information
INFO - Sleeping 90000 ms to wait for load information...
INFO - Node /98.137.30.37 is now part of the cluster
INFO - Node /98.137.30.38 is now part of the cluster
INFO - InetAddress /98.137.30.37 is now UP
INFO - InetAddress /98.137.30.38 is now UP
INFO - Joining: getting bootstrap token
INFO - New token will be user148315419 to assume load from /98.137.30.38 INFO - Joining: sleeping 30000 for pending range setup
INFO - Bootstrapping

But when I run nodetool streams, no streams are transferring:

Mode: Bootstrapping
Not sending any streams.
Not receiving any streams.

And it doesn’t look like the node is getting any data. Any ideas?

Thanks for the help...

Brian


On 3/2/10 12:22 PM, "Jonathan Ellis" <jbellis@gmail.com> wrote:

On Tue, Mar 2, 2010 at 1:54 PM, Brian Frank= Cooper
<cooperb@yahoo-inc.com> wrote:<= BR> > Hi folks,
>
> I’m running 0.5 and I had 2 nodes up and running, then added a 3= rd node in
> bootstrap mode. I understand from other discussion list threads that t= he new
> node doesn’t serve reads while it is bootstrapping, but does tha= t mean it
> won’t connect at all?

it doesn't start the thrift listener until it is bootstrapped, so yes.

(you can tell when it's bootstrapped by when it appears in nodeprobe
ring.  0.6 also adds bootstrap progress reporting via jmx.)

> When I try to connect from my java client, or
> cassandra-cli, I get the exception below. Is it the expected behavior?=
> (Also, cassandra-cli says “Connected to xxx.yahoo.com” eve= n though it isn’t
> really connected...)

This is fixed in https://issues.apache.org/jira/browse/CASSANDRA-807
for 0.6, fwiw.

-Jonathan


-- =
Brian Cooper
Principal Research Scientist
Yahoo! Research

 --_000_C7B33ADC980Acooperbyahooinccom_--