lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Emir Arnautović <emir.arnauto...@sematext.com>
Subject Re: Unbalanced CPU no SolrCloud
Date Mon, 16 Oct 2017 10:32:44 GMT
Hi Mahmoud,
Is this something that you see constantly? Network charts suggests that your servers are loaded
equally and as you said - you are not using routing so expected. Disk read/write and CPU are
not equal and it is expected to not be equal during heavy indexing since it also triggers
segment merges which require those resources. Even if host same documents (e.g. leader and
replica) merges are not likely to happen at the same time and you can expect to see such cases.


Thanks,
Emir
--
Monitoring - Log Management - Alerting - Anomaly Detection
Solr & Elasticsearch Consulting Support Training - http://sematext.com/



> On 16 Oct 2017, at 11:58, Mahmoud Almokadem <prog.mahmoud@gmail.com> wrote:
> 
> Here are the screen shots for the two server metrics on Amazon
> 
> https://ibb.co/kxBQam
> https://ibb.co/fn0Jvm
> https://ibb.co/kUpYT6
> 
> 
> 
> On Mon, Oct 16, 2017 at 11:37 AM, Mahmoud Almokadem <prog.mahmoud@gmail.com>
> wrote:
> 
>> Hi Emir,
>> 
>> We doesn't use routing.
>> 
>> Servers is already balanced and the number of documents on each shard are
>> approximately the same.
>> 
>> Nothing running on the servers except Solr and ZooKeeper.
>> 
>> I initialized the client as
>> 
>> String zkHost = "192.168.1.89:2181,192.168.1.99:2181";
>> 
>> CloudSolrClient solrCloud = new CloudSolrClient.Builder()
>>                    .withZkHost(zkHost)
>>                    .build();
>> 
>>            solrCloud.setIdField("document_id");
>>            solrCloud.setDefaultCollection(collection);
>>            solrCloud.setRequestWriter(new BinaryRequestWriter());
>> 
>> 
>> And the documents are approximately the same size.
>> 
>> I Used 10 threads with 10 SolrClients to send data to solr and every
>> thread send a batch of 1000 documents every time.
>> 
>> Thanks,
>> Mahmoud
>> 
>> 
>> 
>> On Mon, Oct 16, 2017 at 11:01 AM, Emir Arnautović <
>> emir.arnautovic@sematext.com> wrote:
>> 
>>> Hi Mahmoud,
>>> Do you use routing? Are your servers equally balanced - do you end up
>>> having approximately the same number of documents hosted on both servers
>>> (counted all shards)?
>>> Do you have anything else running on those servers?
>>> How do you initialise your SolrJ client?
>>> Are documents of similar size?
>>> 
>>> Thanks,
>>> Emir
>>> --
>>> Monitoring - Log Management - Alerting - Anomaly Detection
>>> Solr & Elasticsearch Consulting Support Training - http://sematext.com/
>>> 
>>> 
>>> 
>>>> On 16 Oct 2017, at 10:46, Mahmoud Almokadem <prog.mahmoud@gmail.com>
>>> wrote:
>>>> 
>>>> We've installed SolrCloud 7.0.1 with two nodes and 8 shards per node.
>>>> 
>>>> The configurations and the specs of the two servers are identical.
>>>> 
>>>> When running bulk indexing using SolrJ we see one of the servers is
>>> fully
>>>> loaded as you see on the images and the other is normal.
>>>> 
>>>> Images URLs:
>>>> 
>>>> https://ibb.co/jkE6gR
>>>> https://ibb.co/hyzvam
>>>> https://ibb.co/mUpvam
>>>> https://ibb.co/e4bxo6
>>>> 
>>>> How can I figure this issue?
>>>> 
>>>> Thanks,
>>>> Mahmoud
>>> 
>>> 
>> 


Mime
View raw message