lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Michael McCandless" <luc...@mikemccandless.com>
Subject Re: Strange Exception
Date Tue, 22 Apr 2008 10:49:04 GMT
Yikes, OK.  Thanks for bringing closure!

Mike

eks dev <eksdev@yahoo.co.uk> wrote:
> Mike,
>  just to bring closure on this one. It is definitely not Lucene problem, as after restart
the same index on disk was loaded  into RAMDirectory and is in production since Friday, no
problems around. This index serves 350k / Queries per day in average.
>
>  It is still not clear to us how this could have happened, this is read only index, fully
optimized, gets only searched.  And in spite of it, we have seen this funny corruption...
it escapes me... this index was 67 days used on this same machine without problems, but java/OS/memory
chips managed to corrupt it in memory.
>
>  I have recommended burn-in tests for this machine, with spec focus on memory...
>
>
>
>
>
>  ----- Original Message ----
>  > From: Michael McCandless <lucene@mikemccandless.com>
>  > To: java-dev@lucene.apache.org
>  > Sent: Friday, 18 April, 2008 4:56:14 PM
>  > Subject: Re: Strange Exception
>  >
>  >
>  > Some sort of index corruption seems likely.  Is it expected that the
>  > docs in this index only have 2 fields?  The exception is happening
>  > because TermBuffer is trying to look up the field name for
>  > fieldNumber=3..
>  >
>  > What version of Lucene is this?
>  >
>  > How was the index produced?
>  >
>  > Were there any other exceptions before this?
>  >
>  > Mike
>  >
>  > eks dev wrote:
>  > >
>  > > does anyone have an idea what the reason for this could be? corrupt
>  > > index? (this is RAMDirectoryloaded from FSDirectory!?)
>  > > unfortunately I have very limited possibilities to access this
>  > > system to dig deeper....
>  > >
>  > > thanks!
>  > >
>  > > INFO   | jvm 49   | 2008/04/10 11:30:41 | 080410 113041 SEVERE
>  > > Server handler 0 on 4326 call error:
>  > > java.lang.IndexOutOfBoundsException: Index: 3, Size: 2
>  > > INFO   | jvm 49   | 2008/04/10 11:30:41 |
>  > > java.lang.IndexOutOfBoundsException: Index: 3, Size: 2
>  > > INFO   | jvm 49   | 2008/04/10 11:30:41 |  at
>  > > java.util.ArrayList.RangeCheck(ArrayList.java:547)
>  > > INFO   | jvm 49   | 2008/04/10 11:30:41 |  at
>  > > java.util.ArrayList.get(ArrayList.java:322)
>  > > INFO   | jvm 49   | 2008/04/10 11:30:41 |  at
>  > > org.apache.lucene.index.FieldInfos.fieldInfo(Unknown Source)
>  > > INFO   | jvm 49   | 2008/04/10 11:30:41 |  at
>  > > org.apache.lucene.index.FieldInfos.fieldName(Unknown Source)
>  > > INFO   | jvm 49   | 2008/04/10 11:30:41 |  at
>  > > org.apache.lucene.index.TermBuffer.read(Unknown Source)
>  > > INFO   | jvm 49   | 2008/04/10 11:30:41 |  at
>  > > org..apache.lucene.index.SegmentTermEnum.next(Unknown Source)
>  > > INFO   | jvm 49   | 2008/04/10 11:30:41 |  at
>  > > org.apache.lucene.index.SegmentTermEnum.scanTo(Unknown Source)
>  > > INFO   | jvm 49   | 2008/04/10 11:30:41 |  at
>  > > org.apache.lucene.index.TermInfosReader.scanEnum(Unknown Source)
>  > > INFO   | jvm 49   | 2008/04/10 11:30:41 |  at
>  > > org.apache.lucene.index.TermInfosReader.get(Unknown Source)
>  > > INFO   | jvm 49   | 2008/04/10 11:30:41 |  at
>  > > org.apache.lucene.index.SegmentReader.docFreq(Unknown Source)
>  > > INFO   | jvm 49   | 2008/04/10 11:30:41 |  at
>  > > org.apache.lucene.search.IndexSearcher.docFreq(Unknown Source)
>  > > INFO   | jvm 49   | 2008/04/10 11:30:41 |  at
>  > > org.apache.lucene.search.Similarity.idf(Unknown Source)
>  > > INFO   | jvm 49   | 2008/04/10 11:30:41 |  at
>  > > org.apache.lucene.search.TermQuery$TermWeight.(Unknown Source)
>  > > INFO   | jvm 49   | 2008/04/10 11:30:41 |  at
>  > > org.apache.lucene.search.TermQuery.createWeight(Unknown Source)
>  > > INFO   | jvm 49   | 2008/04/10 11:30:41 |  at
>  > > org.apache.lucene.search.BooleanQuery$BooleanWeight.(Unknown
>  > > Source)
>  > > INFO   | jvm 49   | 2008/04/10 11:30:41 |  at
>  > > org.apache..lucene.search.BooleanQuery.createWeight(Unknown Source)
>  > > INFO   | jvm 49   | 2008/04/10 11:30:41 |  at
>  > > org.apache.lucene.search.Query.weight(Unknown Source)
>  > > INFO   | jvm 49   | 2008/04/10 11:30:41 |  at
>  > > org.apache.lucene.search.Searcher.createWeight(Unknown Source)
>  > > INFO   | jvm 49   | 2008/04/10 11:30:41 |  at
>  > > org.apache.lucene.search.Searcher.search(Unknown Source)
>  > >
>  > >
>  > >
>  > >       __________________________________________________________
>  > > Sent from Yahoo! Mail.
>  > > A Smarter Email http://uk.docs.yahoo.com/nowyoucan.html
>  > >
>  > >
>  > > ---------------------------------------------------------------------
>  > > To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
>  > > For additional commands, e-mail: java-dev-help@lucene.apache.org
>  > >
>  >
>  >
>  > ---------------------------------------------------------------------
>  > To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
>  > For additional commands, e-mail: java-dev-help@lucene.apache.org
>
>
>
>       __________________________________________________________
>  Sent from Yahoo! Mail.
>  A Smarter Email http://uk.docs.yahoo.com/nowyoucan.html
>
>
>  ---------------------------------------------------------------------
>  To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
>  For additional commands, e-mail: java-dev-help@lucene.apache.org
>
>

---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


Mime
View raw message