lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Franz Garsombke <fgarsom...@yahoo.com>
Subject Lucene 2.9.1 'read past EOF' IOException under system load
Date Tue, 19 Jan 2010 20:52:55 GMT

We have been able to expose this exception under system load but NOT with
individual requests.

Lucene version is 2.9.1. These indexed files are being read over NFS.

Java version is: 
Java(TM) SE Runtime Environment (build 1.6.0_11-b03)
Java HotSpot(TM) 64-Bit Server VM (build 11.0-b16, mixed mode)

Linux version:
Linux 2.6.18-92.el5 #1 SMP Tue Apr 29 13:16:15 EDT 2008 x86_64 x86_64 x86_64
GNU/Linux

The exception we have seen:

Caused by: java.io.IOException: read past EOF
        at
org.apache.lucene.store.BufferedIndexInput.refill(BufferedIndexInput.java:151)
        at
org.apache.lucene.store.BufferedIndexInput.readByte(BufferedIndexInput.java:38)
        at org.apache.lucene.store.IndexInput.readInt(IndexInput.java:70)
        at org.apache.lucene.store.IndexInput.readLong(IndexInput.java:93)
        at org.apache.lucene.index.FieldsReader.doc(FieldsReader.java:210)
        at
org.apache.lucene.index.SegmentReader.document(SegmentReader.java:948)
        at
org.apache.lucene.index.DirectoryReader.document(DirectoryReader.java:506)
        at
org.apache.lucene.index.MultiReader.document(MultiReader.java:241)
        at
org.apache.lucene.index.IndexReader.document(IndexReader.java:947)
        at
org.apache.lucene.search.IndexSearcher.doc(IndexSearcher.java:152)


We can not reproduce this problem unless we are running a load test with 50
users for 7 minutes.

Here is the code using the ScoreDoc[] and Searcher.

  public void iterateResults(ScoreDoc[] hits, Searcher searcher) {
    for (int i = 0; i < hits.length; ++i) {
      try {
        Document d = searcher.doc(hits[i].doc);
        // do something with document
      } catch (Exception e) {
        throw new RuntimeException("problem iterating results", e);
      }
    }

Thoughts?

Thanks in advance

Franz Garsombke


-- 
View this message in context: http://old.nabble.com/Lucene-2.9.1-%27read-past-EOF%27-IOException-under-system-load-tp27232534p27232534.html
Sent from the Lucene - Java Users mailing list archive at Nabble.com.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


Mime
View raw message