Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 70FB9DC02 for ; Wed, 1 Aug 2012 10:21:53 +0000 (UTC) Received: (qmail 69137 invoked by uid 500); 1 Aug 2012 10:21:51 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 69113 invoked by uid 500); 1 Aug 2012 10:21:51 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 69104 invoked by uid 99); 1 Aug 2012 10:21:51 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Aug 2012 10:21:51 +0000 X-ASF-Spam-Status: No, hits=-5.0 required=5.0 tests=FSL_RCVD_USER,RCVD_IN_DNSWL_HI,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of Roshni.Rajagopal@wal-mart.com designates 161.165.225.14 as permitted sender) Received: from [161.165.225.14] (HELO PPES-Mail-E1.wal-mart.com) (161.165.225.14) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Aug 2012 10:21:45 +0000 Received: from pps.filterd (PPES-Mail-E1 [127.0.0.1]) by PPES-Mail-E1.wal-mart.com (8.14.4/8.14.4) with SMTP id q71AJZlq006423 for ; Wed, 1 Aug 2012 05:21:23 -0500 Received: from honts3517.homeoffice.wal-mart.com ([161.165.225.1]) by PPES-Mail-E1.wal-mart.com with ESMTP id 16eyx6rtqk-1 (version=TLSv1/SSLv3 cipher=RC4-MD5 bits=128 verify=NOT) for ; Wed, 01 Aug 2012 05:21:23 -0500 Received: from DCNTS3700us.homeoffice.Wal-Mart.com (172.29.104.83) by HONTS3517.homeoffice.Wal-Mart.com (161.166.40.181) with Microsoft SMTP Server (TLS) id 8.3.192.1; Wed, 1 Aug 2012 05:21:23 -0500 Received: from DCNTS3000XCHUS.homeoffice.Wal-Mart.com ([172.29.104.74]) by DCNTS3700us.homeoffice.Wal-Mart.com ([172.29.104.83]) with mapi; Wed, 1 Aug 2012 03:21:23 -0700 From: Roshni Rajagopal To: "user@cassandra.apache.org" Date: Wed, 1 Aug 2012 03:24:04 -0700 Subject: Re: Unsuccessful attempt to add a second node to a ring. Thread-Topic: Unsuccessful attempt to add a second node to a ring. Thread-Index: Ac1vz2Xgv0QwXUglQJCKkTmf9oeQDw== Message-ID: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: user-agent: Microsoft-MacOutlook/14.2.2.120421 acceptlanguage: en-US Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10432:5.7.7855,1.0.260,0.0.0000 definitions=2012-08-01_04:2012-08-01,2012-08-01,1970-01-01 signatures=0 X-Virus-Checked: Checked by ClamAV on apache.org Ok, sorry it may not be required, I was thinking of a configuration I had done on my local laptop, where I ha= d aliased my IP address. In that case the directories and jmx port needed to be different. Cluster name is same right? From: Jakub Glapa > Reply-To: "user@cassandra.apache.org" > To: "user@cassandra.apache.org" > Subject: Re: Unsuccessful attempt to add a second node to a ring. Hi Roshni, no they are the same, my changes in cassandra.yaml were only in the listen_= address, rpc_address, seeds and initial_token field. The rest is exactly the same as on node1. That's how the file looks on node2: cluster_name: 'Test Cluster' initial_token: 85070591730234615865843651857942052864 hinted_handoff_enabled: true hinted_handoff_throttle_delay_in_ms: 1 authenticator: org.apache.cassandra.auth.AllowAllAuthenticator authority: org.apache.cassandra.auth.AllowAllAuthority partitioner: org.apache.cassandra.dht.RandomPartitioner data_file_directories: - /data/servers/cassandra_sbe_edtool/cassandra_data/data commitlog_directory: /data/servers/cassandra_sbe_edtool/cassandra_data/comm= itlog saved_caches_directory: /data/servers/cassandra_sbe_edtool/cassandra_data/s= aved_caches commitlog_sync: periodic commitlog_sync_period_in_ms: 10000 seed_provider: - class_name: org.apache.cassandra.locator.SimpleSeedProvider parameters: - seeds: "NODE1" flush_largest_memtables_at: 0.75 reduce_cache_sizes_at: 0.85 reduce_cache_capacity_to: 0.6 concurrent_reads: 32 concurrent_writes: 32 memtable_flush_queue_size: 4 sliced_buffer_size_in_kb: 64 storage_port: 7000 ssl_storage_port: 7001 listen_address: NODE2 rpc_address: NODE2 rpc_port: 9160 rpc_keepalive: true rpc_server_type: sync thrift_framed_transport_size_in_mb: 15 thrift_max_message_length_in_mb: 16 incremental_backups: false snapshot_before_compaction: false column_index_size_in_kb: 64 in_memory_compaction_limit_in_mb: 64 multithreaded_compaction: false compaction_throughput_mb_per_sec: 16 compaction_preheat_key_cache: true rpc_timeout_in_ms: 10000 endpoint_snitch: org.apache.cassandra.locator.SimpleSnitch dynamic_snitch_update_interval_in_ms: 100 dynamic_snitch_reset_interval_in_ms: 600000 dynamic_snitch_badness_threshold: 0.1 request_scheduler: org.apache.cassandra.scheduler.NoScheduler index_interval: 128 encryption_options: internode_encryption: none keystore: conf/.keystore keystore_password: cassandra truststore: conf/.truststore truststore_password: cassandra -- regards, pozdrawiam, Jakub Glapa On Wed, Aug 1, 2012 at 10:29 AM, Roshni Rajagopal > wrote: Jakub, Have you set the Data, commitlog, saved cache directories to different ones in each yaml fil= e for each node? Regards, Roshni From: Jakub Glapa >> Reply-To: "user@cassandra.apache.org>" >> To: "user@cassandra.apache.org>" >> Subject: Unsuccessful attempt to add a second node to a ring. Hi Everybody! I'm trying to add a second node to an already operating one node cluster. Some specs: - cassandra 1.0.7 - both nodes have a routable listen_address and rpc_address. - Ports are open: (from node2) telnet node1 7000 is successful - Seeds parameter on node2 points to node 1. [node1] nodetool -h localhost ring Address DC Rack Status State Load Owns= Token node1.ip datacenter1 rack1 Up Normal 74.33 KB 100.00%= 0 - initial token on node2 was specified I see something like that in the logs on node2: DEBUG [main] 2012-07-31 13:50:38,640 CollationController.java (line 76) col= lectTimeOrderedData INFO [main] 2012-07-31 13:50:38,641 StorageService.java (line 667) JOINING= : waiting for ring and schema information DEBUG [WRITE-NODE1/node1.ip] 2012-07-31 13:50:39,642 OutboundTcpConnection.= java (line 206) attempting to connect to NODE1/node1.ip DEBUG [ScheduledTasks:1] 2012-07-31 13:50:40,639 LoadBroadcaster.java (line= 86) Disseminating load info ... INFO [main] 2012-07-31 13:51:08,641 StorageService.java (line 667) JOINING= : schema complete, ready to bootstrap DEBUG [main] 2012-07-31 13:51:08,642 StorageService.java (line 554) ... got= ring + schema info INFO [main] 2012-07-31 13:51:08,642 StorageService.java (line 667) JOINING= : getting bootstrap token DEBUG [main] 2012-07-31 13:51:08,644 BootStrapper.java (line 138) token man= ually specified as 85070591730234615865843651857942052864 DEBUG [main] 2012-07-31 13:51:08,645 Table.java (line 387) applying mutatio= n of row 4c but it doesn't join the ring: [node2] nodetool -h localhost ring Address DC Rack Status State Load Owns= Token node2.ip datacenter1 rack1 Up Normal 13.49 KB 100.00% 8= 5070591730234615865843651857942052864 I'm attaching the full log from node2 startup in debug mode. PS. When I didn't specified the initial token on node2 I ended up with exceptio= n like that: "Exception encountered during startup: No other nodes seen! Unable to boot= strap.If you intended to start a single-node cluster, you should make sure = your broadcast_address (or listen_address) is listed as a seed. Otherwise, you need to determine why the seed being contacted has no knowle= dge of the rest of the cluster. Usually, this can be solved by giving all = nodes the same seed list." I'm not sure how to proceed now. I found a couple of posts with problems li= ke that but they weren't very useful. -- regards, Jakub Glapa This email and any files transmitted with it are confidential and intended = solely for the individual or entity to whom they are addressed. If you have= received this email in error destroy it immediately. *** Walmart Confident= ial *** This email and any files transmitted with it are confidential and intended = solely for the individual or entity to whom they are addressed. If you have= received this email in error destroy it immediately. *** Walmart Confident= ial ***