lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steven Rowe (JIRA)" <>
Subject [jira] [Updated] (LUCENE-772) Index corruption can cause infinite spin loop when Lucene attempts to incorrectly uncompress fields
Date Tue, 18 Sep 2012 16:40:08 GMT


Steven Rowe updated LUCENE-772:

    Fix Version/s:     (was: 4.1)

Changed fix version to 3.6.2, which, if released, will be the final Lucene version that supports
reading compressed fields in indexes created by Lucene 2.X.  See LUCENE-1960.
> Index corruption can cause infinite spin loop when Lucene attempts to incorrectly uncompress
> ---------------------------------------------------------------------------------------------------
>                 Key: LUCENE-772
>                 URL:
>             Project: Lucene - Core
>          Issue Type: Bug
>          Components: core/search
>    Affects Versions: 2.1
>         Environment: Linux (gentoo 2.6.17 at least), jdk 1.5.0_06 and _08 at least, tomcat
5.5. IndexSearcher searching index mounted via NFS; using new lockless commits... We're using
the 01-05-07 nightly build of lucene
>            Reporter: Arthur Smith
>             Fix For: 3.6.2
> Unfortunately I don't have a reproducible case of this (yet), but it's happened twice
now on our production servers in the past few days, after we switched to the new lockless
commits (thanks!). What we're seeing is the search thread running away in the middle of a
seemingly ordinary search, after several hundred thousand queries that worked just fine. The
search index is NFS mounted, and is updated every minute or so during the day by an indexing
process running on a separate server. We do get occasional I/O errors, but we catch and retry
and it seems ok after a few seconds.
> But twice now we've had run-away threads; the thread dump in both cases was caught in
the middle of
> "http-8080-3" daemon prio=1 tid=0x08294688 nid=0x1f0d runnable [0x1f17c000..0x1f17e0b0]
>         at Method)
>         at
>         - locked <0x3d73cba8> (a
>         at
>         at org.apache.lucene.index.FieldsReader.uncompress(
>         at org.apache.lucene.index.FieldsReader.addField(
>         at org.apache.lucene.index.FieldsReader.doc(
>         at org.apache.lucene.index.SegmentReader.document(
>         - locked <0x3cefbdd8> (a org.apache.lucene.index.SegmentReader)       
at org.apache.lucene.index.MultiReader.document(
>         at org.apache.lucene.index.IndexReader.document(       
>         at
> [...]
> Any ideas what this could be? Thanks!

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see:

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message