lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Michael McCandless <luc...@mikemccandless.com>
Subject Re: index corruption with latest lucene
Date Mon, 05 May 2008 20:32:13 GMT

Hi Mark,

Not good!

Can you describe how this index was created?  Did you use multiple  
threads on one IndexWriter?  Multiple sessions of IndexWriter  
appending to the index?  addIndexes*?  Is the index copied from one  
place to another after being written and before being searched?

If you run CheckIndex, what does it report?

Any prior exceptions on this index?

Are your docs a variable schema (different fields)?

Mike

Mark Miller wrote:
> Yeah, its pretty close to 2.3.2, but I think from last week mabye.
>
> I finally have one of the stack traces (this comes on the tail  
> complete
> laptop failure so I am scrambling here)
>
> java.lang.IndexOutOfBoundsException: Index: 97, Size: 43
>         at java.util.ArrayList.RangeCheck(ArrayList.java:572)
>         at java.util.ArrayList.get(ArrayList.java:347)
>         at org.apache.lucene.index.FieldInfos.fieldInfo 
> (FieldInfos.java:260)
>         at org.apache.lucene.index.FieldsReader.doc 
> (FieldsReader.java:184)
>         at org.apache.lucene.index.SegmentReader.document 
> (SegmentReader.java:670)
>         at org.apache.lucene.index.MultiSegmentReader.document 
> (MultiSegmentReader.java:257)
>         at org.apache.lucene.search.IndexSearcher.doc 
> (IndexSearcher.java:97)
>
> On Mon, 2008-05-05 at 14:48 -0500, crspan wrote:
>> coincidence or it is from 2.3.2 ?
>>
>> env:
>> lucene 2.3.2
>> jdk1.6.0_06 & jdk1.5.0_15
>>
>>
>> QueryString:
>> illeg^30.820824 technolog^22.290413 transfer^33.307804
>> Error: java.lang.ArrayIndexOutOfBoundsException:
>> 132704java.lang.ArrayIndexOutOfBoundsException: 132704
>> at
>> org.apache.lucene.search.BooleanScorer2$Coordinator.coordFactor 
>> (BooleanScorer2.java:55)
>> at org.apache.lucene.search.BooleanScorer2.score 
>> (BooleanScorer2.java:358)
>> at org.apache.lucene.search.BooleanScorer2.score 
>> (BooleanScorer2.java:320)
>> at org.apache.lucene.search.IndexSearcher.search 
>> (IndexSearcher.java:146)
>> at org.apache.lucene.search.IndexSearcher.search 
>> (IndexSearcher.java:113)
>> at org.apache.lucene.search.Searcher.search(Searcher.java:132)
>> at
>> org.cr.search.TrecQueryRelevanceFeedback.main 
>> (TrecQueryRelevanceFeedback.java:776)
>>
>>
>> QueryString:
>> oceanograph^68.48028 vessel^43.191563
>> Error:
>> java.lang.ArrayIndexOutOfBoundsExceptionjava.lang.ArrayIndexOutOfBoun 
>> dsException
>> at java.lang.System.arraycopy(Native Method)
>> at
>> org.apache.lucene.index.TermVectorsReader.readTermVector 
>> (TermVectorsReader.java:353)
>> at
>> org.apache.lucene.index.TermVectorsReader.readTermVectors 
>> (TermVectorsReader.java:287)
>> at org.apache.lucene.index.TermVectorsReader.get 
>> (TermVectorsReader.java:232)
>> at
>> org.apache.lucene.index.SegmentReader.getTermFreqVectors 
>> (SegmentReader.java:981)
>> at org.cr.rf.RelevanceFeedback.RelFeedbackWeight 
>> (RelevanceFeedback.java:134)
>> at
>> org.cr.search.TrecQueryRelevanceFeedback.main 
>> (TrecQueryRelevanceFeedback.java:781)
>>
>>
>>
>>
>> Mark Miller wrote:
>>> Any recent changes that would expose index corruption?
>>>
>>> I am getting two new errors when trying to search:
>>>
>>> nullpointer fieldsreaders line 260
>>>
>>> indexoutofbounds on fieldinfo line 185
>>>
>>> I am kind of screwed, because reindexing fixes this, but I cant  
>>> reindex!
>>>
>>> Any ideas?
>>>
>>>
>>> -------------------------------------------------------------------- 
>>> -
>>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>>
>>>
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>


---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


Mime
View raw message