Mailing-List: contact solr-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: solr-user@lucene.apache.org
MIME-Version: 1.0
From: Webster Homer <webster.homer@sial.com>
Date: Wed, 3 May 2017 12:16:09 -0500
Message-ID: <CAKTEqf=J7CZ2b5EtF9UQbmd5joFRv-OdkNDwTVpHRKNVL5quNg@mail.gmail.com>
Subject: Throttle CDCR packets?
To: solr-user@lucene.apache.org
Content-Type: multipart/alternative; boundary=94eb2c124f600698ab054ea1d0a1
archived-at: Wed, 03 May 2017 17:16:16 -0000

--94eb2c124f600698ab054ea1d0a1
Content-Type: text/plain; charset=UTF-8

We are trying to move to solrcloud in production. Our production servers
are in the Google Cloud, we load data to an on premises cloud and use CDCR
to replicate to two solr clouds hosted in GCloud. The problem is that its
sending packets at too high a rate for our VPN to Google. Is there a way to
throttle the packet rate in CDCR?

is there some combination of replicator schedule and batchSize that would
slow it down? This is a stopper for us, if we cannot address this we may
have to abandon plans for using solrcloud

This is our current configuration for source CDCR

"/cdcr": {"name": "/cdcr","class": "solr.CdcrRequestHandler","replica": [{"
zkHost": "
ae1b-ecom-mzk01:2181,ae1b-ecom-mzk02:2181,ae1b-ecom-mzk03:2181/solr","source
": "bb-catalog-material","target": "bb-catalog-material"},{"zkHost": "
uc1f-ecom-mzk01:2181,uc1f-ecom-mzk02:2181,uc1f-ecom-mzk03:2181/solr","source
": "bb-catalog-material","target": "bb-catalog-material"}],"replicator": {"
threadPoolSize": 4,"schedule": 1000,"batchSize": 250},"updateLogSynchronizer
": {"schedule": 60000}}

-- 


This message and any attachment are confidential and may be privileged or 
otherwise protected from disclosure. If you are not the intended recipient, 
you must not copy this message or attachment or disclose the contents to 
any other person. If you have received this transmission in error, please 
notify the sender immediately and delete the message and any attachment 
from your system. Merck KGaA, Darmstadt, Germany and any of its 
subsidiaries do not accept liability for any omissions or errors in this 
message which may arise as a result of E-Mail-transmission or for damages 
resulting from any unauthorized changes of the content of this message and 
any attachment thereto. Merck KGaA, Darmstadt, Germany and any of its 
subsidiaries do not guarantee that this message is free of viruses and does 
not accept liability for any damages caused by any virus transmitted 
therewith.

Click http://www.emdgroup.com/disclaimer to access the German, French, 
Spanish and Portuguese versions of this disclaimer.

--94eb2c124f600698ab054ea1d0a1--