Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: java-user@lucene.apache.org
MIME-Version: 1.0
In-Reply-To: 
 <CAJc64EUPjFJPxSnJfYhgU_7omhbOqQB+m=vVVF-nePf1EcD27w@mail.gmail.com>
References: 
 <CAJc64EUPjFJPxSnJfYhgU_7omhbOqQB+m=vVVF-nePf1EcD27w@mail.gmail.com>
From: Umesh Prasad <umesh.iitk@gmail.com>
Date: Tue, 9 Jun 2015 13:41:01 +0530
Message-ID: 
 <CAJc64EVXSc+Ywty8oZ_=fn++Da8NvwyUiz829wOD6FW9hgoA=w@mail.gmail.com>
Subject: Re: Lucene Index Corrupted
To: java-user@lucene.apache.org
Content-Type: multipart/alternative; boundary=089e01183396ce988f0518114d51

--089e01183396ce988f0518114d51
Content-Type: text/plain; charset=UTF-8

Diagonistic info from checkIndex tool

  7 of 85: name=_psc docCount=10184501

    codec=Lucene46

    compound=false

    numFiles=14

    size (MB)=5,174.959

    diagnostics = {timestamp=1433473052105, os=Linux,
os.version=2.6.32-5-amd64, mergeFactor=10, source=merge,
lucene.version=4.6.1 1560866 - mark - 2014-01-23 20:11:13, os.arch=amd

64, mergeMaxNumSegments=-1, java.version=1.7.0_60, java.vendor=Oracle
Corporation}

    has deletions [delGen=38]

    test: open reader.........OK [2754377 deleted docs]

    test: fields..............OK [1940 fields]

    test: field norms.........OK [0 fields]

    test: terms, freq, prox...OK [41624084 terms; 792821362 terms/docs
pairs; 648955541 tokens]

    test (ignoring deletes): terms, freq, prox...OK [52210535 terms;
914842773 terms/docs pairs; 706281156 tokens]

    test: stored fields.......OK [22290372 total field count; avg 3 fields
per doc]

    test: term vectors........OK [0 total vector count; avg 0 term/freq
vector fields per doc]

    test: docvalues...........ERROR [213]

java.lang.ArrayIndexOutOfBoundsException: 213

        at
org.apache.lucene.codecs.lucene45.Lucene45DocValuesProducer$2.get(Lucene45DocValuesProducer.java:325)

        at org.apache.lucene.util.LongValues.get(LongValues.java:35)

        at
org.apache.lucene.index.CheckIndex.checkNumericDocValues(CheckIndex.java:1479)

        at
org.apache.lucene.index.CheckIndex.checkDocValues(CheckIndex.java:1523)

        at
org.apache.lucene.index.CheckIndex.testDocValues(CheckIndex.java:1345)

        at
org.apache.lucene.index.CheckIndex.checkIndex(CheckIndex.java:626)

        at org.apache.lucene.index.CheckIndex.main(CheckIndex.java:1941)

FAILED

    WARNING: fixIndex() would remove reference to this segment; full
exception:

java.lang.RuntimeException: DocValues test failed

        at
org.apache.lucene.index.CheckIndex.checkIndex(CheckIndex.java:639)

        at org.apache.lucene.index.CheckIndex.main(CheckIndex.java:1941)

On 9 June 2015 at 13:40, Umesh Prasad <umesh.iitk@gmail.com> wrote:

> Hi,
>
>     During update, our lucene index has got corrupted and we are unable to
> root cause the same .. Any help/pointers would be appreciated ..
>
>
> java.io.IOException: Corrupted
>
>         at
> org.apache.lucene.util.packed.BlockPackedReader.<init>(BlockPackedReader.java:57)
> ~[lucene-core-4.6.1.jar:4.6.1 1560866 - mark - 2014-01-23 20:11:13]
>
>         at
> org.apache.lucene.codecs.lucene45.Lucene45DocValuesProducer.getNumeric(Lucene45DocValuesProducer.java:306)
> ~[lucene-core-4.6.1.jar:4.6.1 1560866 - mark - 2014-01-23 20:11:13]
>
>         at
> org.apache.lucene.codecs.lucene45.Lucene45DocValuesProducer.getNumeric(Lucene45DocValuesProducer.java:285)
> ~[lucene-core-4.6.1.jar:4.6.1 1560866 - mark - 2014-01-23 20:11:13]
>
>         at
> org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat$FieldsReader.getNumeric(PerFieldDocValuesFormat.java:267)
> ~[lucene-core-4.6.1.jar:4.6.1 1560866 - mark - 2014-01-23 20:11:13]
>
>         at
> org.apache.lucene.index.SegmentReader.getNumericDocValues(SegmentReader.java:408)
> ~[lucene-core-4.6.1.jar:4.6.1 1560866 - mark - 2014-01-23 20:11:13]
>
>         at
> org.apache.lucene.index.ReadersAndUpdates$1.<init>(ReadersAndUpdates.java:408)
> ~[lucene-core-4.6.1.jar:4.6.1 1560866 - mark - 2014-01-23 20:11:13]
>
>         at
> org.apache.lucene.index.ReadersAndUpdates.writeFieldUpdates(ReadersAndUpdates.java:407)
> ~[lucene-core-4.6.1.jar:4.6.1 1560866 - mark - 2014-01-23 20:11:13]
>
>         at
> org.apache.lucene.index.BufferedUpdatesStream.applyDeletesAndUpdates(BufferedUpdatesStream.java:287)
> ~[lucene-core-4.6.1.jar:4.6.1 1560866 - mark - 2014-01-23 20:11:13]
>
>         at
> org.apache.lucene.index.IndexWriter.applyAllDeletesAndUpdates(IndexWriter.java:3126)
> ~[lucene-core-4.6.1.jar:4.6.1 1560866 - mark - 2014-01-23 20:11:13]
>
>         at
> org.apache.lucene.index.IndexWriter.applyDeletesAndPurge(IndexWriter.java:4655)
> ~[lucene-core-4.6.1.jar:4.6.1 1560866 - mark - 2014-01-23 20:11:13]
>
>         at
> org.apache.lucene.index.DocumentsWriter$ApplyDeletesEvent.process(DocumentsWriter.java:673)
> ~[lucene-core-4.6.1.jar:4.6.1 1560866 - mark - 2014-01-23 20:11:13]
>
>         at
> org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:4679)
> ~[lucene-core-4.6.1.jar:4.6.1 1560866 - mark - 2014-01-23 20:11:13]
>
>         at
> org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:4671)
> ~[lucene-core-4.6.1.jar:4.6.1 1560866 - mark - 2014-01-23 20:11:13]
>
>         at
> org.apache.lucene.index.IndexWriter.updateNumericDocValue(IndexWriter.java:1574)
> ~[lucene-core-4.6.1.jar:4.6.1 1560866 - mark - 2014-01-23 20:11:13]
>
>
>
>
> --
> Thanks & Regards
> Umesh Prasad
> Tech Lead @ flipkart.com
>
>  in.linkedin.com/pub/umesh-prasad/6/5bb/580/
>
>


-- 
Thanks & Regards
Umesh Prasad
Tech Lead @ flipkart.com

 in.linkedin.com/pub/umesh-prasad/6/5bb/580/

--089e01183396ce988f0518114d51--