lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ganesh (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SOLR-9466) During concurrency some Solr document are not seen even after soft and hard commit
Date Thu, 01 Sep 2016 12:44:20 GMT
Ganesh created SOLR-9466:
----------------------------

             Summary: During concurrency some Solr document are not seen even after soft and
hard commit
                 Key: SOLR-9466
                 URL: https://issues.apache.org/jira/browse/SOLR-9466
             Project: Solr
          Issue Type: Bug
      Security Level: Public (Default Security Level. Issues are Public)
          Components: SolrCloud
    Affects Versions: 4.10.2
         Environment: Cent OS
            Reporter: Ganesh
            Priority: Critical


Solr cloud with 2 nodes, master master, with 5 collection and 2 shards in each collection.


During concurrent usage of SOLR where both updates and search is sent to SOLR server, some
of our updates / adding of new documents are getting lost.

We could see that update hitting solr and we could see it in localhost_access file of tomcat,
also in catalina.out. But still we couldn't see that record while searching. 

Following is the catalina.out logs for the document which is getting indexed properly.

Sep 01, 2016 7:39:31 AM org.apache.solr.update.processor.LogUpdateProcessor processAdd
FINE: PRE_UPDATE add{,id=CUA0000004390000019223370564139207241C3LEA0000020769223370567404392838EXCC3000001}
{{params(crid=CUA0000004390000019223370564139207241C3LEA0000020769223370567404392838EXCC3000001),defaults(wt=xml)}}
Sep 01, 2016 7:39:31 AM org.apache.solr.update.TransactionLog <init>
FINE: New TransactionLog file=/ebdata2/solrdata/IOB_shard1_replica1/data/tlog/tlog.0000000000000220856,
exists=false, size=0, openExisting=false
Sep 01, 2016 7:39:31 AM org.apache.solr.update.SolrCmdDistributor submit
FINE: sending update to http://xx.xx.xx.xx:7070/solr/IOB_shard1_replica2/ retry:0 add{_version_=1544254202941800448,id=CUA0000004390000019223370564139207241C3LEA0000020769223370567404392838EXCC3000001}
params:update.distrib=FROMLEADER&distrib.from=http%3A%2F%2Fxx.xx.xx.xx%3A7070%2Fsolr%2FIOB_shard1_replica1%2F
Sep 01, 2016 7:39:31 AM org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrServer$Runner
run
FINE: starting runner: org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrServer$Runner@3fb794b2
Sep 01, 2016 7:39:31 AM org.apache.solr.update.processor.LogUpdateProcessor finish
FINE: PRE_UPDATE FINISH {{params(crid=CUA0000004390000019223370564139207241C3LEA0000020769223370567404392838EXCC3000001),defaults(wt=xml)}}
Sep 01, 2016 7:39:31 AM org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrServer$Runner
run
FINE: finished: org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrServer$Runner@3fb794b2
Sep 01, 2016 7:39:31 AM org.apache.solr.update.processor.LogUpdateProcessor finish
INFO: [IOB_shard1_replica1] webapp=/solr path=/update params={crid=CUA0000004390000019223370564139207241C3LEA0000020769223370567404392838EXCC3000001}
{add=[CUA0000004390000019223370564139207241C3LEA0000020769223370567404392838EXCC3000001 (1544254202941800448)]}
0 9
Sep 01, 2016 7:39:31 AM org.apache.solr.servlet.SolrDispatchFilter doFilter
FINE: Closing out SolrRequest: {{params(crid=CUA0000004390000019223370564139207241C3LEA0000020769223370567404392838EXCC3000001),defaults(wt=xml)}}

For the one which document is not getting indexed, we could only following log in catalina.out

Sep 01, 2016 7:39:56 AM org.apache.solr.update.processor.LogUpdateProcessor finish
FINE: PRE_UPDATE FINISH {{params(crid=CUA0000004390000019223370564139182810C3LEA0000020179223370567061972057EXCC1000002),defaults(wt=xml)}}
Sep 01, 2016 7:39:56 AM org.apache.solr.update.processor.LogUpdateProcessor finish
INFO: [IOB_shard1_replica1] webapp=/solr path=/update params={crid=CUA0000004390000019223370564139182810C3LEA0000020179223370567061972057EXCC1000002}
{} 0 1
Sep 01, 2016 7:39:56 AM org.apache.solr.servlet.SolrDispatchFilter doFilter
FINE: Closing out SolrRequest: {{params(crid=CUA0000004390000019223370564139182810C3LEA0000020179223370567061972057EXCC1000002),defaults(wt=xml)}}

We have set autosoftcommit to 1 seconds and autohardcommit to 30 seconds.

We are getting any errors or exceptions in the log. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message