Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id E3262D4C5 for ; Mon, 3 Dec 2012 14:06:47 +0000 (UTC) Received: (qmail 78482 invoked by uid 500); 3 Dec 2012 14:06:45 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 77827 invoked by uid 500); 3 Dec 2012 14:06:41 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 77802 invoked by uid 99); 3 Dec 2012 14:06:40 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 03 Dec 2012 14:06:40 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of srecon@yandex.ru designates 95.108.130.94 as permitted sender) Received: from [95.108.130.94] (HELO forward12.mail.yandex.net) (95.108.130.94) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 03 Dec 2012 14:06:34 +0000 Received: from web28f.yandex.ru (web28f.yandex.ru [95.108.131.162]) by forward12.mail.yandex.net (Yandex) with ESMTP id C03FDC21614 for ; Mon, 3 Dec 2012 18:06:12 +0400 (MSK) Received: from 127.0.0.1 (localhost.localdomain [127.0.0.1]) by web28f.yandex.ru (Yandex) with ESMTP id 79FFFB3019E; Mon, 3 Dec 2012 18:06:12 +0400 (MSK) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yandex.ru; s=mail; t=1354543572; bh=0HVeTboTk53zviSkfakMxZn54OjNpkZ6dD4qtrh5vzI=; h=From:To:Subject:Date; b=TRnQjxPYC1QH8ZnsTLOng4ox5egrCzHCbGCFMKV1v9sF6mqtkQ6NQZOBubI+rkRBV RTotTyhu3aj6lnncFZjlJ83EAdG3FGEC2tmf0LlWFD3fyEOO2q5Ocnb4hFcihhaQVm slC+PHrVM50Ytha9zbvaWet+6j1hUw8jeIZbEXoE= Received: from [91.241.12.31] ([91.241.12.31]) by web28f.yandex.ru with HTTP; Mon, 03 Dec 2012 18:06:12 +0400 From: =?koi8-r?B?+8HNyc0=?= To: user@cassandra.apache.org Subject: Data not replicating to all datacenters MIME-Version: 1.0 Message-Id: <154841354543572@web28f.yandex.ru> X-Mailer: Yamail [ http://yandex.ru ] 5.0 Date: Mon, 03 Dec 2012 18:06:12 +0400 Content-Transfer-Encoding: 7bit Content-Type: text/plain X-Virus-Checked: Checked by ClamAV on apache.org Hello Owen, Seems you did not configure token for all nodes correctly. See the section Calculating Tokens for multiple data centers here http://www.datastax.com/docs/0.8/install/cluster_init Best regards Shamim --- On Mon, Dec 3, 2012 at 4:42 PM, Owen Davies wrote: We have a 2 data center test cassandra setup running, and are writing to it using LOCAL_QUORUM. When reading, sometimes the data is there, sometimes it is not, which we think is a replication issue, even though we have left it plenty of time after the writes. We have the following setup: cassandra -v: 1.1.6 cassandra.yaml ----------------------- cluster_name: something endpoint_snitch: PropertyFileSnitch cassandra-topology.properties -------------------------------------------- 192.168.1.1=dc1:rack1 192.168.1.2=dc1:rack1 192.168.1.3=dc1:rack1 192.168.2.1=dc2:rack1 192.168.2.2=dc2:rack1 192.168.2.3=dc3:rack1 default=nodc:norack cassandra-cli -------------------- Keyspace: example: Replication Strategy: org.apache.cassandra.locator.NetworkTopologyStrategy Durable Writes: true Options: [dc1:3, dc2:3] nodetool ring ------------------- Address DC Rack Status State Load Effective-Ownership Token 159447687142037741049740936276011715300 192.168.1.2 dc1 rack1 Up Normal 111.17 GB 100.00% 67165620003619490909052924699950283577 192.168.1.1 dc1 rack1 Up Normal 204.57 GB 100.00% 71045951808949151217931264995073558408 192.168.2.1 dc2 rack1 Up Normal 209.92 GB 100.00% 107165019770579893816561717940612111506 192.168.1.3 dc1 rack1 Up Normal 209.92 GB 100.00% 114165363957966360026729000065495595953 192.168.2.3 dc2 rack1 Up Normal 198.22 GB 100.00% 147717787092318068320268200174271353451 192.168.2.2 dc2 rack1 Up Normal 179.31 GB 100.00% 159447687142037741049740936276011715300 Does anyone have any ideas why every server does not have the same amount of data on? Thanks, Owen