lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Amrit Sarkar (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (SOLR-11003) Enabling bi-directional CDCR active-active clusters
Date Sat, 02 Sep 2017 06:22:00 GMT

    [ https://issues.apache.org/jira/browse/SOLR-11003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16151422#comment-16151422
] 

Amrit Sarkar edited comment on SOLR-11003 at 9/2/17 6:21 AM:
-------------------------------------------------------------

SOLR-11278: the reason behind _CdcrBootstrapTest failing intermittently_, is causing {{CdcrBidiretionalTest}}
to fail too. I ran beast iters of 100 few days back, in July, it didn't fail once. We definitely
need to address SOLR-11278 asap.

{code}
  [beaster]   2> 60134 ERROR (updateExecutor-43-thread-1-processing-n:127.0.0.1:52448_solr
x:cdcr-cluster2_shard1_replica_n1 s:shard1 c:cdcr-cluster2 r:core_node2) [n:127.0.0.1:52448_solr
c:cdcr-cluster2 s:shard1 r:core_node2 x:cdcr-cluster2_shard1_replica_n1] o.a.s.h.CdcrRequestHandler
Bootstrap operation failed
  [beaster]   2> java.util.concurrent.ExecutionException: java.lang.AssertionError
  [beaster]   2> 	at java.util.concurrent.FutureTask.report(FutureTask.java:122)
  [beaster]   2> 	at java.util.concurrent.FutureTask.get(FutureTask.java:192)
  [beaster]   2> 	at org.apache.solr.handler.CdcrRequestHandler.lambda$handleBootstrapAction$0(CdcrRequestHandler.java:646)
  [beaster]   2> 	at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
  [beaster]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  [beaster]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  [beaster]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
  [beaster]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
  [beaster]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
  [beaster]   2> 	at java.lang.Thread.run(Thread.java:745)
  [beaster]   2> Caused by: java.lang.AssertionError
  [beaster]   2> 	at org.apache.solr.handler.CdcrRequestHandler$BootstrapCallable.call(CdcrRequestHandler.java:789)
  [beaster]   2> 	at org.apache.solr.handler.CdcrRequestHandler$BootstrapCallable.call(CdcrRequestHandler.java:716)
  [beaster]   2> 	at com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:197)
  [beaster]   2> 	... 5 more
{code}


was (Author: sarkaramrit2@gmail.com):
SOLR-11278: the reason behind _CdcrBootstrapTest failing intermittently_, is {{CdcrBidiretionalTest}}
to fail too. I ran beast iters of 100 few days back, in July, it didn't fail once. We definitely
need to address SOLR-11278 asap.

{code}
  [beaster]   2> 60134 ERROR (updateExecutor-43-thread-1-processing-n:127.0.0.1:52448_solr
x:cdcr-cluster2_shard1_replica_n1 s:shard1 c:cdcr-cluster2 r:core_node2) [n:127.0.0.1:52448_solr
c:cdcr-cluster2 s:shard1 r:core_node2 x:cdcr-cluster2_shard1_replica_n1] o.a.s.h.CdcrRequestHandler
Bootstrap operation failed
  [beaster]   2> java.util.concurrent.ExecutionException: java.lang.AssertionError
  [beaster]   2> 	at java.util.concurrent.FutureTask.report(FutureTask.java:122)
  [beaster]   2> 	at java.util.concurrent.FutureTask.get(FutureTask.java:192)
  [beaster]   2> 	at org.apache.solr.handler.CdcrRequestHandler.lambda$handleBootstrapAction$0(CdcrRequestHandler.java:646)
  [beaster]   2> 	at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
  [beaster]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  [beaster]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  [beaster]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
  [beaster]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
  [beaster]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
  [beaster]   2> 	at java.lang.Thread.run(Thread.java:745)
  [beaster]   2> Caused by: java.lang.AssertionError
  [beaster]   2> 	at org.apache.solr.handler.CdcrRequestHandler$BootstrapCallable.call(CdcrRequestHandler.java:789)
  [beaster]   2> 	at org.apache.solr.handler.CdcrRequestHandler$BootstrapCallable.call(CdcrRequestHandler.java:716)
  [beaster]   2> 	at com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:197)
  [beaster]   2> 	... 5 more
{code}

> Enabling bi-directional CDCR active-active clusters
> ---------------------------------------------------
>
>                 Key: SOLR-11003
>                 URL: https://issues.apache.org/jira/browse/SOLR-11003
>             Project: Solr
>          Issue Type: Improvement
>      Security Level: Public(Default Security Level. Issues are Public) 
>          Components: CDCR
>            Reporter: Amrit Sarkar
>            Assignee: Varun Thacker
>         Attachments: sample-configs.zip, SOLR-11003.patch, SOLR-11003.patch, SOLR-11003.patch,
SOLR-11003.patch, SOLR-11003.patch, SOLR-11003-tlogutils.patch
>
>
> The latest version of Solr CDCR across collections / clusters is in active-passive format,
where we can index into source collection and the updates gets forwarded to the passive one
and vice-versa is not supported.
> https://lucene.apache.org/solr/guide/6_6/cross-data-center-replication-cdcr.html
> https://issues.apache.org/jira/browse/SOLR-6273
> We are try to get a  design ready to index in both collections and the updates gets reflected
across the collections in real-time. ClusterACollectionA => ClusterBCollectionB | ClusterBCollectionB
=> ClusterACollectionA.
> The best use-case would be to we keep indexing in ClusterACollectionA which forwards
the updates to ClusterBCollectionB. If ClusterACollectionA gets down, we point the indexer
and searcher application to ClusterBCollectionB. Once ClusterACollectionA is up, depending
on updates count, they will be bootstrapped or forwarded to ClusterACollectionA from ClusterBCollectionB
and keep indexing on the ClusterBCollectionB.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message