lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Kumar Limbu <kumarli...@gmail.com>
Subject Why is SolrCloud doing a full copy of the index?
Date Sat, 04 May 2013 08:06:59 GMT
We have Solr setup on 3 machines with only a single shard. We are using Solr
4.0 and currently have around 7 Million documents in our index. The size of
our index is around 25 GB. We have a zookeeper ensemble of 3 zookeeper
instances.
 
Let's call the servers in our setup server (A), (B) and (C). All updates to
Solr goes via server (C). Searches are performed on server (A) and (B). The
updates are normally propagated incrementally from server (C) to the other 2
servers.  Intermittently we have noted that the servers (A) and (B) makes a
full copy of the index from server (C). This is not ideal because when this
happens performance suffers. This occurs quite randomly and can occur on any
of the other 2 nodes i.e. (A) and (B). 
 
On the server (C), which is the leader, we see errors like the following .We
suspect this might be the reason why a full index copy occurs in the other
nodes but we haven't been able to find out why this error is occurring.
There is no connectivity issue with the servers.
 
See the stacktrace below:

SEVERE: shard update error StdNode:
http://serverA/solr/rn0/:org.apache.solr.client.solrj.SolrServerException:
IOException occured when talking to server at: http:// serverA/solr/rn0
        at
org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:413)
        at
org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
        at
org.apache.solr.update.SolrCmdDistributor$1.call(SolrCmdDistributor.java:335)
        at
org.apache.solr.update.SolrCmdDistributor$1.call(SolrCmdDistributor.java:1)
        at
java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
        at java.util.concurrent.FutureTask.run(FutureTask.java:138)
        at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
        at
java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
        at java.util.concurrent.FutureTask.run(FutureTask.java:138)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
        at java.lang.Thread.run(Thread.java:662)
Caused by: org.apache.http.NoHttpResponseException: The target server failed
to respond
        at
org.apache.http.impl.conn.DefaultResponseParser.parseHead(DefaultResponseParser.java:101)
        at
org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:252)
        at
org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:282)
        at
org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:247)
        at
org.apache.http.impl.conn.AbstractClientConnAdapter.receiveResponseHeader(AbstractClientConnAdapter.java:216)
        at
org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:298)
        at
org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
        at
org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:647)
        at
org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:464)
        at
org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:820)
        at
org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:754)
        at
org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:732)
        at
org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:352)
        ... 11 more
                                
If anyone can help us troubleshoot this problem we will really appreciate
the help. If there are any questions regarding our setup or further
information regarding the error, please let me know.                 




--
View this message in context: http://lucene.472066.n3.nabble.com/Why-is-SolrCloud-doing-a-full-copy-of-the-index-tp4060800.html
Sent from the Solr - User mailing list archive at Nabble.com.

Mime
View raw message