lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "julien" <j.ger...@noos.fr>
Subject RE : Test issue with new version of .tis file
Date Wed, 21 Jan 2004 20:06:25 GMT
Hi all,

Doug,

I wrote a class ( attached to the mail) wich always throw the exception.
The program generate random data, so the data are not the problem, but
perhaps the amount of data added. I didn't try to debug by myself (lack
of time, but next week, perhaps, I could help on this).

I test the optimize method after each Document insertion, the exception
is thrown in this case nearly ( in number of documents, less than 10
Document ) before the merge segment Exception.

So, I say good luck :)

Regards,

Julien.

-----Message d'origine-----
De : julien gerard [mailto:j.gerard@noos.fr] 
Envoyé : mardi 20 janvier 2004 18:34
À : Lucene Developers List
Objet : Re: Test issue with new version of .tis file


Ok, I'll do this tomorrow, I'll generate sample data to reproduce this.

Cheers,

Julien.

[------  En réponse à  Doug Cutting <cutting@apache.org>:  ------]
 
>>Julien,
>>
>>Thanks for the report.  This sounds like it could be a
>>bug in my recent
>>changes.  A reproducible standalone test case would be
>>best, but if you 
>>can't manage to create one, here's something else to
>>try:
>>   1. Find the document that, when added, triggers the
>>problem.
>>   2. Just before that document is added, try instead
>>calling 
>>IndexWriter.optimize().
>>   3. If the optimize() fails, then the problem is in the
>>index before 
>>the document is added, and I may be able to use that
>>index to debug the 
>>problem.  So you could tar or zip it up and put it on a
>>public web or 
>>FTP server.
>>
>>Does that make sense?
>>
>>Thanks,
>>
>>Doug
>>
>>julien gerard wrote:
>>> Hi,
>>> 
>>> I've tested the new version of the Lucene index with
>>doug's modification on the creation of the .tis file to accelerate 
>>phrase or multiterm query( 
>>http://www.mail-archive.com/lucene-dev@jakarta.apache.org/msg04332.htm
>>l
>>), but I have the following Exception during the index
>>creation :
>>> 
>>> java.io.IOException: read past EOF
>>> 	at
>>org.apache.lucene.store.InputStream.refill(InputStream.java:192)
>>> 	at
>>org.apache.lucene.index.SegmentTermEnum.next(SegmentTermEnum.java(Comp
>>iled
>>Code))
>>> 	at
>>org.apache.lucene.index.SegmentTermEnum.next(SegmentTermEnum.java(Comp
>>iled
>>Code))
>>> 	at
>>org.apache.lucene.index.SegmentTermEnum.next(SegmentTermEnum.java(Comp
>>iled
>>Code))
>>> 	at
>>org.apache.lucene.index.SegmentTermEnum.next(SegmentTermEnum.java(Comp
>>iled
>>Code))
>>> 	at
>>org.apache.lucene.index.SegmentMerger.mergeTermInfos(SegmentMerger.jav
>>a(Compiled
>>Code))
>>> 	at
>>org.apache.lucene.index.SegmentMerger.mergeTermInfos(SegmentMerger.jav
>>a(Compiled
>>Code))
>>> 	at
>>org.apache.lucene.index.SegmentMerger.mergeTerms(SegmentMerger.java:19
>>2)
>>> 	at
>>org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:99)
>>> 	at
>>org.apache.lucene.index.IndexWriter.mergeSegments(IndexWriter.java:430
>>)
>>> 	at
>>org.apache.lucene.index.IndexWriter.maybeMergeSegments(IndexWriter.jav
>>a(Compiled
>>Code))
>>> 	at
>>org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:260)
>>> 	at
>>org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:244)
>>> 
>>> I'll try to do a simple TestCase to reproduce this
>>exception, but if anyone have an explanation, it would be great.
>>> 
>>> - Running on Wsad jre 1.3
>>> - this index creation work well on Lucene 1.3 final
>>release
>>> - I run this test with the last classes on CVS
>>repository ( others issues known?? ).
>>> - All my index creation do the same Exception ( data
>>are pretty different )
>>> 
>>> I'll post more information later. If you want specific
>>information, tell me, I'll try to reply soon.
>>> 
>>> Regards,
>>> 
>>> Julien GERARD.
>>> 
>>> 
>>> 
>>>
>>---------------------------------------------------------------------
>>> To unsubscribe, e-mail:
>>lucene-dev-unsubscribe@jakarta.apache.org
>>> For additional commands, e-mail:
>>lucene-dev-help@jakarta.apache.org
>>> 
>>
>>
>>---------------------------------------------------------------------
>>To unsubscribe, e-mail: lucene-dev-unsubscribe@jakarta.apache.org
>>For additional commands, e-mail:
>>lucene-dev-help@jakarta.apache.org
>>
>>




---------------------------------------------------------------------
To unsubscribe, e-mail: lucene-dev-unsubscribe@jakarta.apache.org
For additional commands, e-mail: lucene-dev-help@jakarta.apache.org


Mime
View raw message