lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Khawaja Shams <kssh...@gmail.com>
Subject Exceptions in merge thread (while optimizing) causing problems with subsequent reopens
Date Thu, 09 Apr 2009 23:59:26 GMT
Hello,
  I am having a problem with reopening the IndexReader with Lucene 2.4 ( I
updated to 2.4.1, but still no luck). The exception is preceded by an
exception in optimizing the index. I am not reopening the reader while the
commit or optimization is going on in the writer (optimizing happens in the
same thread, but much less often). The issues go away once I turn off
optimizations. I was also getting this problem before I turned off the use
of compound files. I would appreciate any guidance.

Thanks!

Regards,
Khawaja


2009-04-09 15:57:47,033 (941820) [Index Maint Thread] ERROR
gov.nasa.ensemble.core.indexer.Indexer  - java.io.IOException: background
merge hit exception: _8:C41258 _9:C11382 into _a [optimize]
java.io.IOException: background merge hit exception: _8:C41258 _9:C11382
into _a [optimize]
    at org.apache.lucene.index.IndexWriter.optimize(IndexWriter.java:2273)
    at org.apache.lucene.index.IndexWriter.optimize(IndexWriter.java:2218)
    at org.apache.lucene.index.IndexWriter.optimize(IndexWriter.java:2198)
    at
gov.nasa.ensemble.core.indexer.Indexer$IndexMaintThread.run(Indexer.java:102)
Caused by: org.apache.lucene.index.CorruptIndexException: doc counts differ
for segment _8: fieldsReader shows 30074 but segmentInfo shows 41258
    at
org.apache.lucene.index.SegmentReader.initialize(SegmentReader.java:362)
    at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:306)
    at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:260)
    at
org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4220)
    at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3884)
    at
org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:205)
    at
org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:260)
Exception in thread "Lucene Merge Thread #0"
org.apache.lucene.index.MergePolicy$MergeException:
org.apache.lucene.index.CorruptIndexException: doc counts differ for segment
_8: fieldsReader shows 30074 but segmentInfo shows 41258
    at
org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException(ConcurrentMergeScheduler.java:309)
    at
org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:286)
Caused by: org.apache.lucene.index.CorruptIndexException: doc counts differ
for segment _8: fieldsReader shows 30074 but segmentInfo shows 41258
    at
org.apache.lucene.index.SegmentReader.initialize(SegmentReader.java:362)
    at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:306)
    at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:260)
    at
org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4220)
    at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3884)
    at
org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:205)
    at
org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:260)
2009-04-09 15:57:52,814 (947601) [Index Maint Thread] ERROR
gov.nasa.ensemble.core.indexer.Indexer  - java.io.FileNotFoundException:
/opt/users/merops/index/_a.fnm (No such file or directory)
java.io.FileNotFoundException: /opt/users/merops/index/_a.fnm (No such file
or directory)
    at java.io.RandomAccessFile.open(Native Method)
    at java.io.RandomAccessFile.<init>(RandomAccessFile.java:212)
    at
org.apache.lucene.store.FSDirectory$FSIndexInput$Descriptor.<init>(FSDirectory.java:552)
    at
org.apache.lucene.store.FSDirectory$FSIndexInput.<init>(FSDirectory.java:582)
    at org.apache.lucene.store.FSDirectory.openInput(FSDirectory.java:488)
    at org.apache.lucene.store.FSDirectory.openInput(FSDirectory.java:482)
    at org.apache.lucene.index.FieldInfos.<init>(FieldInfos.java:58)
    at
org.apache.lucene.index.SegmentReader.initialize(SegmentReader.java:341)
    at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:306)
    at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:269)
    at
org.apache.lucene.index.MultiSegmentReader.doReopen(MultiSegmentReader.java:201)
    at
org.apache.lucene.index.DirectoryIndexReader$2.doBody(DirectoryIndexReader.java:157)
    at
org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:653)
    at
org.apache.lucene.index.DirectoryIndexReader.reopen(DirectoryIndexReader.java:179)
    at
gov.nasa.ensemble.core.indexer.Indexer$IndexMaintThread.run(Indexer.java:106)

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message