lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Koji Sekiguchi <k...@r.email.ne.jp>
Subject background merge hit exception
Date Fri, 09 Sep 2011 12:01:41 GMT
A user here hit the exception the title says when optimizing. They're using Solr 1.4
(Lucene 2.9) running on a server that mounts NFS for index.

I think I know the famous "Stale NFS File Handle IOException" problem, but I think it causes
FileNoutFoundException. Is there any chance to hit the exception in the title due
to NFS? If so what is the mechanism?

The full stack trace is:

2011/09/07 9:40:00 org.apache.solr.update.DirectUpdateHandler2 commit
INFO: start commit(optimize=true,waitFlush=true,waitSearcher=true,expungeDeletes=false)

:

2011/09/07 9:40:52 org.apache.solr.update.processor.LogUpdateProcessor finish
INFO: {} 0 52334
2011/09/07 9:40:52 org.apache.solr.common.SolrException log
FATAL: java.io.IOException: background merge hit exception: _73ie:C290089 _73if:C34 _73ig:C31
_73ir:C356 into _73is [optimize] [mergeDocStores]
        at org.apache.lucene.index.IndexWriter.optimize(IndexWriter.java:2908)
        at org.apache.lucene.index.IndexWriter.optimize(IndexWriter.java:2829)
        at org.apache.solr.update.DirectUpdateHandler2.commit(DirectUpdateHandler2.java:403)
        at
org.apache.solr.update.processor.RunUpdateProcessor.processCommit(RunUpdateProcessorFactory.java:85)
        at org.apache.solr.handler.XMLLoader.processUpdate(XMLLoader.java:169)
        at org.apache.solr.handler.XMLLoader.load(XMLLoader.java:69)
        at
org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:54)
        at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:131)
        at org.apache.solr.core.SolrCore.execute(SolrCore.java:1316)
        at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:338)
        at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:241)
        at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
        at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
        at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
        at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
        at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:525)
        at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:128)
        at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
        at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:568)
        at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
        at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:286)
        at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:845)
        at
org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:583)
        at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:447)
        at java.lang.Thread.run(Thread.java:619)
Caused by: java.lang.RuntimeException: mergeFields produced an invalid result: docCount is
290089
but fdx file size is 2310144 file=_73is.fdx file exists?=true; now aborting this merge to
prevent
index corruption
        at org.apache.lucene.index.SegmentMerger.mergeFields(SegmentMerger.java:369)
        at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:153)
        at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:5112)
        at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:4675)
        at org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:235)
        at
org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:291\
)


koji
-- 
Check out "Query Log Visualizer" for Apache Solr
http://www.rondhuit-demo.com/loganalyzer/loganalyzer.html
http://www.rondhuit.com/en/

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


Mime
View raw message