cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Abhishek Kumar Maheshwari <Abhishek.Maheshw...@timesinternet.in>
Subject RE: [Multi DC] Old Data Not syncing from Existing cluster to new Cluster
Date Mon, 30 Jan 2017 04:43:53 GMT
But how I will tell rebuild command source DC if I have more than 2 Dc?

@dinking, yes I run the command, and it did some strange thing now:

Datacenter: DRPOCcluster
========================
Status=Up/Down
|/ State=Normal/Leaving/Joining/Moving
--  Address        Load       Tokens       Owns    Host ID                               Rack
UN  172.29.XX.XXX  140.16 GB  256          ?       badf985b-37da-4735-b468-8d3a058d4b60  01
UN  172.29. XX.XXX  82.04 GB   256          ?       317061b2-c19f-44ba-a776-bcd91c70bbdd 
03
UN  172.29. XX.XXX  85.29 GB   256          ?       9bf0d1dc-6826-4f3b-9c56-cec0c9ce3b6c 
02
Datacenter: dc_india
====================
Status=Up/Down
|/ State=Normal/Leaving/Joining/Moving
--  Address        Load       Tokens       Owns    Host ID                               Rack
UN  172.26. XX.XXX   79.09 GB   256          ?       3e8133ed-98b5-418d-96b5-690a1450cd30
 RACK1
UN  172.26. XX.XXX   79.39 GB   256          ?       7d3f5b25-88f9-4be7-b0f5-746619153543
 RACK2



In source DC (dc_india) we have near about 79 GB data. But in new DC each node has more than
79 GB data and Seed IP have near about 2 times data. Below is replication:
Data Key Space:
alter KEYSPACE wls WITH replication = {'class': 'NetworkTopologyStrategy', 'DRPOCcluster':
'3','dc_india':'2'}  AND durable_writes = true;
alter KEYSPACE adlog WITH replication = {'class': 'NetworkTopologyStrategy', 'DRPOCcluster':
'3','dc_india':'2'}  AND durable_writes = true;

New DC('DRPOCcluster') system Key Space:

alter KEYSPACE system_distributed WITH replication = {'class': 'NetworkTopologyStrategy',
'DRPOCcluster': '3','dc_india':'0'}  AND durable_writes = true;
alter KEYSPACE system_auth WITH replication = {'class': 'NetworkTopologyStrategy', 'DRPOCcluster':
'3','dc_india':'0'}  AND durable_writes = true;
alter KEYSPACE system_traces WITH replication = {'class': 'NetworkTopologyStrategy', 'DRPOCcluster':
'3','dc_india':'0'}  AND durable_writes = true;
alter KEYSPACE "OpsCenter" WITH replication = {'class': 'NetworkTopologyStrategy', 'DRPOCcluster':
'3','dc_india':'0'}  AND durable_writes = true;

Old  DC(‘dc_india’) system Key Space:

alter KEYSPACE system_distributed WITH replication = {'class': 'NetworkTopologyStrategy',
'DRPOCcluster': '0','dc_india':'2'}  AND durable_writes = true;
alter KEYSPACE system_auth WITH replication = {'class': 'NetworkTopologyStrategy', 'DRPOCcluster':
'0','dc_india':'2'}  AND durable_writes = true;
alter KEYSPACE system_traces WITH replication = {'class': 'NetworkTopologyStrategy', 'DRPOCcluster':
'0','dc_india':'2'}  AND durable_writes = true;
alter KEYSPACE "OpsCenter" WITH replication = {'class': 'NetworkTopologyStrategy', 'DRPOCcluster':
'0','dc_india':'2'}  AND durable_writes = true;

why this happening? I did soething wrong?

Thanks & Regards,
Abhishek Kumar Maheshwari
+91- 9999805591 (Mobile)
Times Internet Ltd. | A Times of India Group Company
FC - 6, Sector 16A, Film City,  Noida,  U.P. 201301 | INDIA
P Please do not print this email unless it is absolutely necessary. Spread environmental awareness.

From: kurt greaves [mailto:kurt@instaclustr.com]
Sent: Saturday, January 28, 2017 3:27 AM
To: user@cassandra.apache.org
Subject: Re: [Multi DC] Old Data Not syncing from Existing cluster to new Cluster

What Dikang said, in your original email you are passing -dc to rebuild. This is incorrect.
Simply run nodetool rebuild <old dc> from each of the nodes in the new dc.

On 28 Jan 2017 07:50, "Dikang Gu" <dikang85@gmail.com<mailto:dikang85@gmail.com>>
wrote:
Have you run 'nodetool rebuild dc_india' on the new nodes?

On Tue, Jan 24, 2017 at 7:51 AM, Benjamin Roth <benjamin.roth@jaumo.com<mailto:benjamin.roth@jaumo.com>>
wrote:
Have you also altered RF of system_distributed as stated in the tutorial?

2017-01-24 16:45 GMT+01:00 Abhishek Kumar Maheshwari <Abhishek.Maheshwari@timesinternet.in<mailto:Abhishek.Maheshwari@timesinternet.in>>:
My Mistake,

Both clusters are up and running.

Datacenter: DRPOCcluster
========================
Status=Up/Down
|/ State=Normal/Leaving/Joining/Moving
--  Address        Load       Tokens       Owns    Host ID                               Rack
UN  172.29.XX.XX  1.65 GB   256          ?       badf985b-37da-4735-b468-8d3a058d4b60  01
UN  172.29.XX.XX  1.64 GB   256          ?       317061b2-c19f-44ba-a776-bcd91c70bbdd  03
UN  172.29.XX.XX  1.64 GB   256          ?       9bf0d1dc-6826-4f3b-9c56-cec0c9ce3b6c  02
Datacenter: dc_india
====================
Status=Up/Down
|/ State=Normal/Leaving/Joining/Moving
--  Address        Load       Tokens       Owns    Host ID                               Rack
UN  172.26.XX.XX   79.90 GB   256          ?       3e8133ed-98b5-418d-96b5-690a1450cd30  RACK1
UN  172.26.XX.XX   80.21 GB   256          ?       7d3f5b25-88f9-4be7-b0f5-746619153543  RACK2

Thanks & Regards,
Abhishek Kumar Maheshwari
+91- 9999805591<tel:+91%2099998%2005591> (Mobile)
Times Internet Ltd. | A Times of India Group Company
FC - 6, Sector 16A, Film City,  Noida,  U.P. 201301 | INDIA
P Please do not print this email unless it is absolutely necessary. Spread environmental awareness.

From: Benjamin Roth [mailto:benjamin.roth@jaumo.com<mailto:benjamin.roth@jaumo.com>]
Sent: Tuesday, January 24, 2017 9:11 PM
To: user@cassandra.apache.org<mailto:user@cassandra.apache.org>
Subject: Re: [Multi DC] Old Data Not syncing from Existing cluster to new Cluster

I am not an expert in bootstrapping new DCs but shouldn't the OLD nodes appear as UP to be
used as a streaming source in rebuild?

2017-01-24 16:32 GMT+01:00 Abhishek Kumar Maheshwari <Abhishek.Maheshwari@timesinternet.in<mailto:Abhishek.Maheshwari@timesinternet.in>>:
Yes, I take all steps. While I am inserting new data is replicating on both DC. But only old
data is not replication in new cluster.

Thanks & Regards,
Abhishek Kumar Maheshwari
+91- 9999805591<tel:+91%2099998%2005591> (Mobile)
Times Internet Ltd. | A Times of India Group Company
FC - 6, Sector 16A, Film City,  Noida,  U.P. 201301 | INDIA
P Please do not print this email unless it is absolutely necessary. Spread environmental awareness.

From: Benjamin Roth [mailto:benjamin.roth@jaumo.com<mailto:benjamin.roth@jaumo.com>]
Sent: Tuesday, January 24, 2017 8:55 PM
To: user@cassandra.apache.org<mailto:user@cassandra.apache.org>
Subject: Re: [Multi DC] Old Data Not syncing from Existing cluster to new Cluster

There is much more to it than just changing the RF in the keyspace!

See here: https://docs.datastax.com/en/cassandra/3.0/cassandra/operations/opsAddDCToCluster.html

2017-01-24 16:18 GMT+01:00 Abhishek Kumar Maheshwari <Abhishek.Maheshwari@timesinternet.in<mailto:Abhishek.Maheshwari@timesinternet.in>>:
Hi All,

I have Cassandra stack with 2 Dc

Datacenter: DRPOCcluster
========================
Status=Up/Down
|/ State=Normal/Leaving/Joining/Moving
--  Address        Load       Tokens       Owns    Host ID                               Rack
UN  172.29.xx.xxx  256  MB   256          ?       b6b8cbb9-1fed-471f-aea9-6a657e7ac80a  01
UN  172.29.xx.xxx  240 MB   256          ?       604abbf5-8639-4104-8f60-fd6573fb2e17  03
UN  172.29. xx.xxx  240 MB   256          ?       32fa79ee-93c6-4e5b-a910-f27a1e9d66c1  02
Datacenter: dc_india
====================
Status=Up/Down
|/ State=Normal/Leaving/Joining/Moving
--  Address        Load       Tokens       Owns    Host ID                               Rack
DN  172.26. .xx.xxx  78.97 GB   256          ?       3e8133ed-98b5-418d-96b5-690a1450cd30
 RACK1
DN  172.26. .xx.xxx  79.18 GB   256          ?       7d3f5b25-88f9-4be7-b0f5-746619153543
 RACK2

dc_india is old Dc which contains all data.
I update keyspace as per below:

alter KEYSPACE wls WITH replication = {'class': 'NetworkTopologyStrategy', 'DRPOCcluster':
'2','dc_india':'2'}  AND durable_writes = true;

but old data is not updating in DRPOCcluster(which is new). Also, while running nodetool rebuild
getting below exception:
Cammand: ./nodetool rebuild -dc dc_india

Exception : nodetool: Unable to find sufficient sources for streaming range (-8756974555527424852,-8755484427030035332]
in keyspace system_distributed

Cassandra version : 3.0.9


Thanks & Regards,
Abhishek Kumar Maheshwari
+91- 9999805591<tel:+91%2099998%2005591> (Mobile)
Times Internet Ltd. | A Times of India Group Company
FC - 6, Sector 16A, Film City,  Noida,  U.P. 201301 | INDIA
P Please do not print this email unless it is absolutely necessary. Spread environmental awareness.




--
Benjamin Roth
Prokurist

Jaumo GmbH · www.jaumo.com<http://www.jaumo.com>
Wehrstraße 46 · 73035 Göppingen · Germany
Phone +49 7161 304880-6<tel:07161%203048806> · Fax +49 7161 304880-1<tel:07161%203048801>
AG Ulm · HRB 731058 · Managing Director: Jens Kammerer



--
Benjamin Roth
Prokurist

Jaumo GmbH · www.jaumo.com<http://www.jaumo.com>
Wehrstraße 46 · 73035 Göppingen · Germany
Phone +49 7161 304880-6<tel:07161%203048806> · Fax +49 7161 304880-1<tel:07161%203048801>
AG Ulm · HRB 731058 · Managing Director: Jens Kammerer



--
Benjamin Roth
Prokurist

Jaumo GmbH · www.jaumo.com<http://www.jaumo.com>
Wehrstraße 46 · 73035 Göppingen · Germany
Phone +49 7161 304880-6<tel:+49%207161%203048806> · Fax +49 7161 304880-1<tel:+49%207161%203048801>
AG Ulm · HRB 731058 · Managing Director: Jens Kammerer



--
Dikang

Budget 2017 may trigger the economic revolution India has been waiting for. For everything
you need to know this Budget Day, stay glued to ET NOW on 1st Feb from 7am.
Mime
View raw message