Return-Path: X-Original-To: apmail-lucene-java-user-archive@www.apache.org Delivered-To: apmail-lucene-java-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 5E12A1016F for ; Wed, 17 Dec 2014 19:56:42 +0000 (UTC) Received: (qmail 3560 invoked by uid 500); 17 Dec 2014 19:56:40 -0000 Delivered-To: apmail-lucene-java-user-archive@lucene.apache.org Received: (qmail 3499 invoked by uid 500); 17 Dec 2014 19:56:40 -0000 Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: java-user@lucene.apache.org Delivered-To: mailing list java-user@lucene.apache.org Received: (qmail 3488 invoked by uid 99); 17 Dec 2014 19:56:39 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 17 Dec 2014 19:56:39 +0000 X-ASF-Spam-Status: No, hits=1.0 required=5.0 tests=DATE_IN_PAST_06_12,HTML_MESSAGE,RCVD_IN_DNSWL_MED,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of shlomitr@il.ibm.com designates 195.75.94.111 as permitted sender) Received: from [195.75.94.111] (HELO e06smtp15.uk.ibm.com) (195.75.94.111) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 17 Dec 2014 19:56:09 +0000 Received: from /spool/local by e06smtp15.uk.ibm.com with IBM ESMTP SMTP Gateway: Authorized Use Only! Violators will be prosecuted for from ; Wed, 17 Dec 2014 19:55:38 -0000 Received: from d06dlp03.portsmouth.uk.ibm.com (9.149.20.15) by e06smtp15.uk.ibm.com (192.168.101.145) with IBM ESMTP SMTP Gateway: Authorized Use Only! Violators will be prosecuted; Wed, 17 Dec 2014 19:55:36 -0000 Received: from b06cxnps3075.portsmouth.uk.ibm.com (d06relay10.portsmouth.uk.ibm.com [9.149.109.195]) by d06dlp03.portsmouth.uk.ibm.com (Postfix) with ESMTP id 237E51B0837D for ; Wed, 17 Dec 2014 19:47:47 +0000 (GMT) Received: from d06av12.portsmouth.uk.ibm.com (d06av12.portsmouth.uk.ibm.com [9.149.37.247]) by b06cxnps3075.portsmouth.uk.ibm.com (8.14.9/8.14.9/NCO v10.0) with ESMTP id sBHJlMAi63766682 for ; Wed, 17 Dec 2014 19:47:22 GMT Received: from d06av12.portsmouth.uk.ibm.com (localhost [127.0.0.1]) by d06av12.portsmouth.uk.ibm.com (8.14.4/8.14.4/NCO v10.0 AVout) with ESMTP id sBHJkHk9021218 for ; Wed, 17 Dec 2014 12:47:22 -0700 Received: from d06ml319.portsmouth.uk.ibm.com (d06ml319.portsmouth.uk.ibm.com [9.149.76.146]) by d06av12.portsmouth.uk.ibm.com (8.14.4/8.14.4/NCO v10.0 AVin) with ESMTP id sBHJbI8j032442 for ; Wed, 17 Dec 2014 12:40:08 -0700 To: "Lucene Users" MIME-Version: 1.0 Subject: Index corruption with lucene 3.0.3 X-KeepSent: D5DFEE26:489D85B0-C2257DB1:00325CD5; type=4; name=$KeepSent X-Mailer: IBM Notes Release 9.0.1SHF211 December 19, 2013 From: Shlomit Rosen Message-ID: Date: Wed, 17 Dec 2014 11:42:13 +0200 X-MIMETrack: Serialize by Router on D06ML319/06/M/IBM(Release 9.0.1FP2|August 03, 2014) at 17/12/2014 21:40:07 Content-Type: multipart/mixed; boundary="=_mixed 00354D32C2257DB1_=" X-TM-AS-MML: disable X-Content-Scanned: Fidelis XPS MAILER x-cbid: 14121719-0021-0000-0000-00000232D8A0 X-Virus-Checked: Checked by ClamAV on apache.org --=_mixed 00354D32C2257DB1_= Content-Type: multipart/alternative; boundary="=_alternative 00354D32C2257DB1_=" --=_alternative 00354D32C2257DB1_= Content-Type: text/plain; charset="US-ASCII" Hello, We have a client that is using lucene 3.0.3. They are working with NAS storage device which recently had permission issues, which might have generated some "out of disk space" exceptions during indexing. We are uncertain if they also suffered JDK crashes in the past few months, as we discovered dmp files and javacores on their system. Consequently, they now have 3 corrupted indices. All of them show a similar issue: java.io.IOException: No sub-file with id _xv.fnm found at org.apache.lucene.index.CompoundFileReader.openInput(CompoundFileReader.java:137) at org.apache.lucene.index.CompoundFileReader.openInput(CompoundFileReader.java:125) at org.apache.lucene.index.FieldInfos.(FieldInfos.java:68) at org.apache.lucene.index.SegmentReader$CoreReaders.(SegmentReader.java:120) at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:605) at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:583) at org.apache.lucene.index.CheckIndex.checkIndex(CheckIndex.java:470) at org.apache.lucene.index.CheckIndex.main(CheckIndex.java:883) Looking at the indices file listing, I see that this file (i.e. - _xv.fnm) is really missing, but I also see that a compound file with the same name exist on disk (i.e. - _xv.cfs). My question is - is there a way to "save" the collection by re-creating the fnm file from the cfs file (or in any other way...?) Or does our client need to re-index the entire collection? (Assuming the checkIndex -fix option is no good, because we cannot know which documents are lost...) I'm attaching the checkIndex output as reference Thanks in advance! Shlomit --=_alternative 00354D32C2257DB1_= Content-Type: text/html; charset="US-ASCII" Hello,

We have a client that is using lucene 3.0.3.
They  are working with NAS storage device which recently had permission issues,
which might have generated some "out of disk space" exceptions during indexing.
We are uncertain if they also suffered JDK crashes in the past few months, as we
discovered dmp files and javacores on their system.

Consequently, they now have 3 corrupted indices.
All of them show a similar issue:

java.io.IOException: No sub-file with id _xv.fnm found
        at org.apache.lucene.index.CompoundFileReader.openInput(CompoundFileReader.java:137)
        at org.apache.lucene.index.CompoundFileReader.openInput(CompoundFileReader.java:125)
        at org.apache.lucene.index.FieldInfos.<init>(FieldInfos.java:68)
        at org.apache.lucene.index.SegmentReader$CoreReaders.<init>(SegmentReader.java:120)
        at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:605)
        at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:583)
        at org.apache.lucene.index.CheckIndex.checkIndex(CheckIndex.java:470)
        at org.apache.lucene.index.CheckIndex.main(CheckIndex.java:883)


Looking at the indices file listing, I see that this file (i.e. - _xv.fnm) is really missing,
but I also see that a compound file with the same name exist on disk (i.e. - _xv.cfs).

My question is -
        is there a way to "save" the collection by re-creating the fnm file from the cfs file (or in any other way...?)
        Or does our client need to re-index the entire collection? (Assuming the checkIndex -fix option is no good, because we cannot know which documents are lost...)

I'm attaching the checkIndex output as reference

Thanks in advance!
Shlomit


--=_alternative 00354D32C2257DB1_=-- --=_mixed 00354D32C2257DB1_= Content-Type: text/plain; name="checkIndexOutput_1.txt" Content-Disposition: attachment; filename="checkIndexOutput_1.txt" Content-Transfer-Encoding: quoted-printable Segments file=3Dsegments=5Fx6 numSegments=3D29 version=3DFORMAT=5FDIAGNOSTI= CS [Lucene 2.9] 1 of 29: name=3D=5Fb8 docCount=3D30727 compound=3Dfalse hasProx=3Dtrue numFiles=3D8 size (MB)=3D442.925 diagnostics =3D {os.arch=3Damd64, mergeDocStores=3Dtrue, java.vendor=3D= IBM Corporation, os=3DWindows Server 2008 R2, mergeFactor=3D10, source=3Dme= rge, java.version=3D1.6.0, lucene.version=3D3.0.3 1039909 - 2010-11-28 19:0= 8:19, optimize=3Dfalse, os.version=3D6.1 build 7601 Service Pack 1} no deletions test: open reader.........OK test: fields..............OK [11 fields] test: field norms.........OK [6 fields] test: terms, freq, prox...OK [383168 terms; 29131147 terms/docs pairs; = 268682250 tokens] test: stored fields.......OK [92181 total field count; avg 3 fields per= doc] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] 2 of 29: name=3D=5Fht docCount=3D11792 compound=3Dfalse hasProx=3Dtrue numFiles=3D8 size (MB)=3D158.439 diagnostics =3D {os.arch=3Damd64, mergeDocStores=3Dtrue, java.vendor=3D= IBM Corporation, os=3DWindows Server 2008 R2, mergeFactor=3D10, source=3Dme= rge, java.version=3D1.6.0, lucene.version=3D3.0.3 1039909 - 2010-11-28 19:0= 8:19, optimize=3Dfalse, os.version=3D6.1 build 7601 Service Pack 1} no deletions test: open reader.........OK test: fields..............OK [7 fields] test: field norms.........OK [2 fields] test: terms, freq, prox...OK [159210 terms; 11338024 terms/docs pairs; = 91542694 tokens] test: stored fields.......OK [35376 total field count; avg 3 fields per= doc] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] 3 of 29: name=3D=5Fky docCount=3D4716 compound=3Dfalse hasProx=3Dtrue numFiles=3D8 size (MB)=3D75.416 diagnostics =3D {os.arch=3Damd64, mergeDocStores=3Dtrue, java.vendor=3D= IBM Corporation, os=3DWindows Server 2008 R2, mergeFactor=3D10, source=3Dme= rge, java.version=3D1.6.0, lucene.version=3D3.0.3 1039909 - 2010-11-28 19:0= 8:19, optimize=3Dfalse, os.version=3D6.1 build 7601 Service Pack 1} no deletions test: open reader.........OK test: fields..............OK [7 fields] test: field norms.........OK [2 fields] test: terms, freq, prox...OK [150944 terms; 4759448 terms/docs pairs; 4= 3546597 tokens] test: stored fields.......OK [14148 total field count; avg 3 fields per= doc] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] 4 of 29: name=3D=5Fml docCount=3D3204 compound=3Dtrue hasProx=3Dtrue numFiles=3D1 size (MB)=3D41.564 diagnostics =3D {os.arch=3Damd64, mergeDocStores=3Dtrue, java.vendor=3D= IBM Corporation, os=3DWindows Server 2008 R2, mergeFactor=3D10, source=3Dme= rge, java.version=3D1.6.0, lucene.version=3D3.0.3 1039909 - 2010-11-28 19:0= 8:19, optimize=3Dfalse, os.version=3D6.1 build 7601 Service Pack 1} no deletions test: open reader.........OK test: fields..............OK [7 fields] test: field norms.........OK [2 fields] test: terms, freq, prox...OK [158026 terms; 3113442 terms/docs pairs; 2= 2692916 tokens] test: stored fields.......OK [9612 total field count; avg 3 fields per = doc] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] 5 of 29: name=3D=5Fo0 docCount=3D2450 compound=3Dtrue hasProx=3Dtrue numFiles=3D1 size (MB)=3D21.541 diagnostics =3D {os.arch=3Damd64, mergeDocStores=3Dtrue, java.vendor=3D= IBM Corporation, os=3DWindows Server 2008 R2, mergeFactor=3D10, source=3Dme= rge, java.version=3D1.6.0, lucene.version=3D3.0.3 1039909 - 2010-11-28 19:0= 8:19, optimize=3Dfalse, os.version=3D6.1 build 7601 Service Pack 1} no deletions test: open reader.........OK test: fields..............OK [7 fields] test: field norms.........OK [2 fields] test: terms, freq, prox...OK [53219 terms; 2254105 terms/docs pairs; 11= 105612 tokens] test: stored fields.......OK [7350 total field count; avg 3 fields per = doc] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] 6 of 29: name=3D=5Fs7 docCount=3D3341 compound=3Dtrue hasProx=3Dtrue numFiles=3D1 size (MB)=3D29.376 diagnostics =3D {os.arch=3Damd64, mergeDocStores=3Dtrue, java.vendor=3D= IBM Corporation, os=3DWindows Server 2008 R2, mergeFactor=3D10, source=3Dme= rge, java.version=3D1.6.0, lucene.version=3D3.0.3 1039909 - 2010-11-28 19:0= 8:19, optimize=3Dfalse, os.version=3D6.1 build 7601 Service Pack 1} no deletions test: open reader.........OK test: fields..............OK [7 fields] test: field norms.........OK [2 fields] test: terms, freq, prox...OK [69215 terms; 3065127 terms/docs pairs; 15= 137136 tokens] test: stored fields.......OK [10023 total field count; avg 3 fields per= doc] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] 7 of 29: name=3D=5Ftf docCount=3D1509 compound=3Dtrue hasProx=3Dtrue numFiles=3D1 size (MB)=3D18.781 diagnostics =3D {os.arch=3Damd64, mergeDocStores=3Dtrue, java.vendor=3D= IBM Corporation, os=3DWindows Server 2008 R2, mergeFactor=3D10, source=3Dme= rge, java.version=3D1.6.0, lucene.version=3D3.0.3 1039909 - 2010-11-28 19:0= 8:19, optimize=3Dfalse, os.version=3D6.1 build 7601 Service Pack 1} no deletions test: open reader.........OK test: fields..............OK [7 fields] test: field norms.........OK [2 fields] test: terms, freq, prox...OK [70994 terms; 1416102 terms/docs pairs; 10= 180774 tokens] test: stored fields.......OK [4527 total field count; avg 3 fields per = doc] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] 8 of 29: name=3D=5Fty docCount=3D1250 compound=3Dtrue hasProx=3Dtrue numFiles=3D1 size (MB)=3D25.537 diagnostics =3D {os.arch=3Damd64, mergeDocStores=3Dtrue, java.vendor=3D= IBM Corporation, os=3DWindows Server 2008 R2, mergeFactor=3D10, source=3Dme= rge, java.version=3D1.6.0, lucene.version=3D3.0.3 1039909 - 2010-11-28 19:0= 8:19, optimize=3Dfalse, os.version=3D6.1 build 7601 Service Pack 1} no deletions test: open reader.........OK test: fields..............OK [7 fields] test: field norms.........OK [2 fields] test: terms, freq, prox...OK [75802 terms; 1260224 terms/docs pairs; 14= 900414 tokens] test: stored fields.......OK [3750 total field count; avg 3 fields per = doc] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] 9 of 29: name=3D=5Fua docCount=3D966 compound=3Dtrue hasProx=3Dtrue numFiles=3D1 size (MB)=3D16.318 diagnostics =3D {os.arch=3Damd64, mergeDocStores=3Dtrue, java.vendor=3D= IBM Corporation, os=3DWindows Server 2008 R2, mergeFactor=3D10, source=3Dme= rge, java.version=3D1.6.0, lucene.version=3D3.0.3 1039909 - 2010-11-28 19:0= 8:19, optimize=3Dfalse, os.version=3D6.1 build 7601 Service Pack 1} no deletions test: open reader.........OK test: fields..............OK [7 fields] test: field norms.........OK [2 fields] test: terms, freq, prox...OK [70442 terms; 930813 terms/docs pairs; 935= 4526 tokens] test: stored fields.......OK [2898 total field count; avg 3 fields per = doc] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] 10 of 29: name=3D=5Fum docCount=3D1019 compound=3Dtrue hasProx=3Dtrue numFiles=3D1 size (MB)=3D17.104 diagnostics =3D {os.arch=3Damd64, mergeDocStores=3Dtrue, java.vendor=3D= IBM Corporation, os=3DWindows Server 2008 R2, mergeFactor=3D10, source=3Dme= rge, java.version=3D1.6.0, lucene.version=3D3.0.3 1039909 - 2010-11-28 19:0= 8:19, optimize=3Dfalse, os.version=3D6.1 build 7601 Service Pack 1} no deletions test: open reader.........OK test: fields..............OK [7 fields] test: field norms.........OK [2 fields] test: terms, freq, prox...OK [63092 terms; 1016149 terms/docs pairs; 97= 58080 tokens] test: stored fields.......OK [3057 total field count; avg 3 fields per = doc] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] 11 of 29: name=3D=5Fv9 docCount=3D1042 compound=3Dtrue hasProx=3Dtrue numFiles=3D1 size (MB)=3D17.91 diagnostics =3D {os.arch=3Damd64, mergeDocStores=3Dtrue, java.vendor=3D= IBM Corporation, os=3DWindows Server 2008 R2, mergeFactor=3D10, source=3Dme= rge, java.version=3D1.6.0, lucene.version=3D3.0.3 1039909 - 2010-11-28 19:0= 8:19, optimize=3Dfalse, os.version=3D6.1 build 7601 Service Pack 1} no deletions test: open reader.........OK test: fields..............OK [7 fields] test: field norms.........OK [2 fields] test: terms, freq, prox...OK [69245 terms; 1093201 terms/docs pairs; 10= 318139 tokens] test: stored fields.......OK [3126 total field count; avg 3 fields per = doc] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] 12 of 29: name=3D=5Fv4 docCount=3D62 compound=3Dtrue hasProx=3Dtrue numFiles=3D1 size (MB)=3D0.43 diagnostics =3D {os.arch=3Damd64, java.vendor=3DIBM Corporation, os=3DW= indows Server 2008 R2, source=3Dflush, java.version=3D1.6.0, lucene.version= =3D3.0.3 1039909 - 2010-11-28 19:08:19, os.version=3D6.1 build 7601 Service= Pack 1} no deletions test: open reader.........OK test: fields..............OK [7 fields] test: field norms.........OK [2 fields] test: terms, freq, prox...OK [4065 terms; 49116 terms/docs pairs; 20838= 5 tokens] test: stored fields.......OK [186 total field count; avg 3 fields per d= oc] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] 13 of 29: name=3D=5Fv5 docCount=3D16 compound=3Dtrue hasProx=3Dtrue numFiles=3D1 size (MB)=3D0.076 diagnostics =3D {os.arch=3Damd64, java.vendor=3DIBM Corporation, os=3DW= indows Server 2008 R2, source=3Dflush, java.version=3D1.6.0, lucene.version= =3D3.0.3 1039909 - 2010-11-28 19:08:19, os.version=3D6.1 build 7601 Service= Pack 1} no deletions test: open reader.........OK test: fields..............OK [7 fields] test: field norms.........OK [2 fields] test: terms, freq, prox...OK [1425 terms; 8250 terms/docs pairs; 30427 = tokens] test: stored fields.......OK [48 total field count; avg 3 fields per do= c] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] 14 of 29: name=3D=5Fv6 docCount=3D11 compound=3Dtrue hasProx=3Dtrue numFiles=3D1 size (MB)=3D0.978 diagnostics =3D {os.arch=3Damd64, java.vendor=3DIBM Corporation, os=3DW= indows Server 2008 R2, source=3Dflush, java.version=3D1.6.0, lucene.version= =3D3.0.3 1039909 - 2010-11-28 19:08:19, os.version=3D6.1 build 7601 Service= Pack 1} no deletions test: open reader.........OK test: fields..............OK [7 fields] test: field norms.........OK [2 fields] test: terms, freq, prox...OK [9794 terms; 37283 terms/docs pairs; 57301= 4 tokens] test: stored fields.......OK [33 total field count; avg 3 fields per do= c] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] 15 of 29: name=3D=5Fv7 docCount=3D66 compound=3Dtrue hasProx=3Dtrue numFiles=3D1 size (MB)=3D0.872 diagnostics =3D {os.arch=3Damd64, java.vendor=3DIBM Corporation, os=3DW= indows Server 2008 R2, source=3Dflush, java.version=3D1.6.0, lucene.version= =3D3.0.3 1039909 - 2010-11-28 19:08:19, os.version=3D6.1 build 7601 Service= Pack 1} no deletions test: open reader.........OK test: fields..............OK [7 fields] test: field norms.........OK [2 fields] test: terms, freq, prox...OK [9720 terms; 70929 terms/docs pairs; 44766= 1 tokens] test: stored fields.......OK [198 total field count; avg 3 fields per d= oc] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] 16 of 29: name=3D=5Fv8 docCount=3D69 compound=3Dtrue hasProx=3Dtrue numFiles=3D1 size (MB)=3D2.388 diagnostics =3D {os.arch=3Damd64, java.vendor=3DIBM Corporation, os=3DW= indows Server 2008 R2, source=3Dflush, java.version=3D1.6.0, lucene.version= =3D3.0.3 1039909 - 2010-11-28 19:08:19, os.version=3D6.1 build 7601 Service= Pack 1} no deletions test: open reader.........OK test: fields..............OK [7 fields] test: field norms.........OK [2 fields] test: terms, freq, prox...OK [18403 terms; 71299 terms/docs pairs; 1565= 563 tokens] test: stored fields.......OK [207 total field count; avg 3 fields per d= oc] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] 17 of 29: name=3D=5Fvk docCount=3D624 compound=3Dtrue hasProx=3Dtrue numFiles=3D1 size (MB)=3D4.435 diagnostics =3D {os.arch=3Damd64, mergeDocStores=3Dtrue, java.vendor=3D= IBM Corporation, os=3DWindows Server 2008 R2, mergeFactor=3D10, source=3Dme= rge, java.version=3D1.6.0, lucene.version=3D3.0.3 1039909 - 2010-11-28 19:0= 8:19, optimize=3Dfalse, os.version=3D6.1 build 7601 Service Pack 1} no deletions test: open reader.........OK test: fields..............OK [7 fields] test: field norms.........OK [2 fields] test: terms, freq, prox...OK [20055 terms; 555375 terms/docs pairs; 209= 1595 tokens] test: stored fields.......OK [1872 total field count; avg 3 fields per = doc] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] 18 of 29: name=3D=5Fvv docCount=3D320 compound=3Dtrue hasProx=3Dtrue numFiles=3D1 size (MB)=3D4.389 diagnostics =3D {os.arch=3Damd64, mergeDocStores=3Dtrue, java.vendor=3D= IBM Corporation, os=3DWindows Server 2008 R2, mergeFactor=3D10, source=3Dme= rge, java.version=3D1.6.0, lucene.version=3D3.0.3 1039909 - 2010-11-28 19:0= 8:19, optimize=3Dfalse, os.version=3D6.1 build 7601 Service Pack 1} no deletions test: open reader.........OK test: fields..............OK [7 fields] test: field norms.........OK [2 fields] test: terms, freq, prox...OK [27593 terms; 315677 terms/docs pairs; 238= 4607 tokens] test: stored fields.......OK [960 total field count; avg 3 fields per d= oc] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] 19 of 29: name=3D=5Fwg docCount=3D219 compound=3Dtrue hasProx=3Dtrue numFiles=3D1 size (MB)=3D1.662 diagnostics =3D {os.arch=3Damd64, mergeDocStores=3Dtrue, java.vendor=3D= IBM Corporation, os=3DWindows Server 2008 R2, mergeFactor=3D10, source=3Dme= rge, java.version=3D1.6.0, lucene.version=3D3.0.3 1039909 - 2010-11-28 19:0= 8:19, optimize=3Dfalse, os.version=3D6.1 build 7601 Service Pack 1} no deletions test: open reader.........OK test: fields..............OK [7 fields] test: field norms.........OK [2 fields] test: terms, freq, prox...OK [11959 terms; 190211 terms/docs pairs; 789= 848 tokens] test: stored fields.......OK [657 total field count; avg 3 fields per d= oc] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] 20 of 29: name=3D=5Fxd docCount=3D346 compound=3Dtrue hasProx=3Dtrue numFiles=3D1 size (MB)=3D2.615 diagnostics =3D {os.arch=3Damd64, mergeDocStores=3Dtrue, java.vendor=3D= IBM Corporation, os=3DWindows Server 2008 R2, mergeFactor=3D10, source=3Dme= rge, java.version=3D1.6.0, lucene.version=3D3.0.3 1039909 - 2010-11-28 19:0= 8:19, optimize=3Dfalse, os.version=3D6.1 build 7601 Service Pack 1} no deletions test: open reader.........OK test: fields..............OK [7 fields] test: field norms.........OK [2 fields] test: terms, freq, prox...OK [14716 terms; 314120 terms/docs pairs; 123= 9198 tokens] test: stored fields.......OK [1038 total field count; avg 3 fields per = doc] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] 21 of 29: name=3D=5Fxo docCount=3D89 compound=3Dtrue hasProx=3Dtrue numFiles=3D1 size (MB)=3D0.643 diagnostics =3D {os.arch=3Damd64, mergeDocStores=3Dtrue, java.vendor=3D= IBM Corporation, os=3DWindows Server 2008 R2, mergeFactor=3D10, source=3Dme= rge, java.version=3D1.6.0, lucene.version=3D3.0.3 1039909 - 2010-11-28 19:0= 8:19, optimize=3Dfalse, os.version=3D6.1 build 7601 Service Pack 1} no deletions test: open reader.........OK test: fields..............OK [7 fields] test: field norms.........OK [2 fields] test: terms, freq, prox...OK [5441 terms; 80208 terms/docs pairs; 29036= 3 tokens] test: stored fields.......OK [267 total field count; avg 3 fields per d= oc] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] 22 of 29: name=3D=5Fxp docCount=3D1 compound=3Dtrue hasProx=3Dtrue numFiles=3D1 size (MB)=3D0.019 diagnostics =3D {os.arch=3Damd64, java.vendor=3DIBM Corporation, os=3DW= indows Server 2008 R2, source=3Dflush, java.version=3D1.6.0, lucene.version= =3D3.0.3 1039909 - 2010-11-28 19:08:19, os.version=3D6.1 build 7601 Service= Pack 1} no deletions test: open reader.........OK test: fields..............OK [7 fields] test: field norms.........OK [2 fields] test: terms, freq, prox...OK [1056 terms; 1056 terms/docs pairs; 4863 t= okens] test: stored fields.......OK [3 total field count; avg 3 fields per doc] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] 23 of 29: name=3D=5Fxq docCount=3D11 compound=3Dtrue hasProx=3Dtrue numFiles=3D1 size (MB)=3D0.085 diagnostics =3D {os.arch=3Damd64, java.vendor=3DIBM Corporation, os=3DW= indows Server 2008 R2, source=3Dflush, java.version=3D1.6.0, lucene.version= =3D3.0.3 1039909 - 2010-11-28 19:08:19, os.version=3D6.1 build 7601 Service= Pack 1} no deletions test: open reader.........OK test: fields..............OK [7 fields] test: field norms.........OK [2 fields] test: terms, freq, prox...OK [1840 terms; 9752 terms/docs pairs; 33863 = tokens] test: stored fields.......OK [33 total field count; avg 3 fields per do= c] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] 24 of 29: name=3D=5Fxr docCount=3D9 compound=3Dtrue hasProx=3Dtrue numFiles=3D1 size (MB)=3D0.073 diagnostics =3D {os.arch=3Damd64, java.vendor=3DIBM Corporation, os=3DW= indows Server 2008 R2, source=3Dflush, java.version=3D1.6.0, lucene.version= =3D3.0.3 1039909 - 2010-11-28 19:08:19, os.version=3D6.1 build 7601 Service= Pack 1} no deletions test: open reader.........OK test: fields..............OK [7 fields] test: field norms.........OK [2 fields] test: terms, freq, prox...OK [1700 terms; 8153 terms/docs pairs; 28730 = tokens] test: stored fields.......OK [27 total field count; avg 3 fields per do= c] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] 25 of 29: name=3D=5Fxs docCount=3D7 compound=3Dtrue hasProx=3Dtrue numFiles=3D1 size (MB)=3D0.057 diagnostics =3D {os.arch=3Damd64, java.vendor=3DIBM Corporation, os=3DW= indows Server 2008 R2, source=3Dflush, java.version=3D1.6.0, lucene.version= =3D3.0.3 1039909 - 2010-11-28 19:08:19, os.version=3D6.1 build 7601 Service= Pack 1} no deletions test: open reader.........OK test: fields..............OK [7 fields] test: field norms.........OK [2 fields] test: terms, freq, prox...OK [1542 terms; 6263 terms/docs pairs; 21500 = tokens] test: stored fields.......OK [21 total field count; avg 3 fields per do= c] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] 26 of 29: name=3D=5Fxt docCount=3D7 compound=3Dtrue hasProx=3Dtrue numFiles=3D1 size (MB)=3D0.056 diagnostics =3D {os.arch=3Damd64, java.vendor=3DIBM Corporation, os=3DW= indows Server 2008 R2, source=3Dflush, java.version=3D1.6.0, lucene.version= =3D3.0.3 1039909 - 2010-11-28 19:08:19, os.version=3D6.1 build 7601 Service= Pack 1} no deletions test: open reader.........OK test: fields..............OK [7 fields] test: field norms.........OK [2 fields] test: terms, freq, prox...OK [1369 terms; 6189 terms/docs pairs; 21575 = tokens] test: stored fields.......OK [21 total field count; avg 3 fields per do= c] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] 27 of 29: name=3D=5Fxu docCount=3D19 compound=3Dtrue hasProx=3Dtrue numFiles=3D1 size (MB)=3D0.146 diagnostics =3D {os.arch=3Damd64, java.vendor=3DIBM Corporation, os=3DW= indows Server 2008 R2, source=3Dflush, java.version=3D1.6.0, lucene.version= =3D3.0.3 1039909 - 2010-11-28 19:08:19, os.version=3D6.1 build 7601 Service= Pack 1} no deletions test: open reader.........OK test: fields..............OK [7 fields] test: field norms.........OK [2 fields] test: terms, freq, prox...OK [2298 terms; 17475 terms/docs pairs; 61062= tokens] test: stored fields.......OK [57 total field count; avg 3 fields per do= c] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] 28 of 29: name=3D=5Fxv docCount=3D14 compound=3Dtrue hasProx=3Dtrue numFiles=3D1 size (MB)=3D0.106 diagnostics =3D {os.arch=3Damd64, java.vendor=3DIBM Corporation, os=3DW= indows Server 2008 R2, source=3Dflush, java.version=3D1.6.0, lucene.version= =3D3.0.3 1039909 - 2010-11-28 19:08:19, os.version=3D6.1 build 7601 Service= Pack 1} no deletions test: open reader.........FAILED WARNING: fixIndex() would remove reference to this segment; full except= ion: java.io.IOException: No sub-file with id =5Fxv.fnm found at org.apache.lucene.index.CompoundFileReader.openInput(CompoundFileReader= .java:137) at org.apache.lucene.index.CompoundFileReader.openInput(CompoundFileReader= .java:125) at org.apache.lucene.index.FieldInfos.(FieldInfos.java:68) at org.apache.lucene.index.SegmentReader$CoreReaders.(SegmentReader.= java:120) at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:605) at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:583) at org.apache.lucene.index.CheckIndex.checkIndex(CheckIndex.java:470) at org.apache.lucene.index.CheckIndex.main(CheckIndex.java:883) 29 of 29: name=3D=5Fxw docCount=3D22 compound=3Dtrue hasProx=3Dtrue numFiles=3D1 size (MB)=3D0.16 diagnostics =3D {os.arch=3Damd64, java.vendor=3DIBM Corporation, os=3DW= indows Server 2008 R2, source=3Dflush, java.version=3D1.6.0, lucene.version= =3D3.0.3 1039909 - 2010-11-28 19:08:19, os.version=3D6.1 build 7601 Service= Pack 1} no deletions test: open reader.........OK test: fields..............OK [7 fields] test: field norms.........OK [2 fields] test: terms, freq, prox...OK [2324 terms; 19289 terms/docs pairs; 67452= tokens] test: stored fields.......OK [66 total field count; avg 3 fields per do= c] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] WARNING: 1 broken segments (containing 14 documents) detected WARNING: would write new segments file, and 14 documents would be lost, if = -fix were specified --=_mixed 00354D32C2257DB1_= Content-Type: text/plain; name="checkIndexOutput_3.txt" Content-Disposition: attachment; filename="checkIndexOutput_3.txt" Content-Transfer-Encoding: quoted-printable Segments file=3Dsegments=5Fww numSegments=3D21 version=3DFORMAT=5FDIAGNOSTI= CS [Lucene 2.9] 1 of 21: name=3D=5Fd3 docCount=3D33569 compound=3Dfalse hasProx=3Dtrue numFiles=3D8 size (MB)=3D488.289 diagnostics =3D {os.arch=3Damd64, mergeDocStores=3Dtrue, java.vendor=3D= IBM Corporation, os=3DWindows Server 2008 R2, mergeFactor=3D10, source=3Dme= rge, java.version=3D1.6.0, lucene.version=3D3.0.3 1039909 - 2010-11-28 19:0= 8:19, optimize=3Dfalse, os.version=3D6.1 build 7601 Service Pack 1} no deletions test: open reader.........OK test: fields..............OK [11 fields] test: field norms.........OK [6 fields] test: terms, freq, prox...OK [472453 terms; 31996989 terms/docs pairs; = 288159061 tokens] test: stored fields.......OK [100707 total field count; avg 3 fields pe= r doc] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] 2 of 21: name=3D=5Fof docCount=3D17551 compound=3Dfalse hasProx=3Dtrue numFiles=3D8 size (MB)=3D221.674 diagnostics =3D {os.arch=3Damd64, mergeDocStores=3Dtrue, java.vendor=3D= IBM Corporation, os=3DWindows Server 2008 R2, mergeFactor=3D10, source=3Dme= rge, java.version=3D1.6.0, lucene.version=3D3.0.3 1039909 - 2010-11-28 19:0= 8:19, optimize=3Dfalse, os.version=3D6.1 build 7601 Service Pack 1} no deletions test: open reader.........OK test: fields..............OK [7 fields] test: field norms.........ERROR [read past EOF] java.io.IOException: read past EOF at org.apache.lucene.store.BufferedIndexInput.readBytes(BufferedIndexInput= .java:138) at org.apache.lucene.index.SegmentReader$Norm.bytes(SegmentReader.java:436) at org.apache.lucene.index.SegmentReader.norms(SegmentReader.java:1093) at org.apache.lucene.index.CheckIndex.testFieldNorms(CheckIndex.java:574) at org.apache.lucene.index.CheckIndex.checkIndex(CheckIndex.java:506) at org.apache.lucene.index.CheckIndex.main(CheckIndex.java:883) test: terms, freq, prox...OK [263594 terms; 16868978 terms/docs pairs; = 126058016 tokens] test: stored fields.......OK [52653 total field count; avg 3 fields per= doc] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] FAILED WARNING: fixIndex() would remove reference to this segment; full except= ion: java.lang.RuntimeException: Field Norm test failed at org.apache.lucene.index.CheckIndex.checkIndex(CheckIndex.java:520) at org.apache.lucene.index.CheckIndex.main(CheckIndex.java:883) 3 of 21: name=3D=5Fvb docCount=3D9309 compound=3Dfalse hasProx=3Dtrue numFiles=3D8 size (MB)=3D106.322 diagnostics =3D {os.arch=3Damd64, mergeDocStores=3Dtrue, java.vendor=3D= IBM Corporation, os=3DWindows Server 2008 R2, mergeFactor=3D10, source=3Dme= rge, java.version=3D1.6.0, lucene.version=3D3.0.3 1039909 - 2010-11-28 19:0= 8:19, optimize=3Dfalse, os.version=3D6.1 build 7601 Service Pack 1} no deletions test: open reader.........OK test: fields..............OK [7 fields] test: field norms.........OK [2 fields] test: terms, freq, prox...OK [164318 terms; 8850839 terms/docs pairs; 5= 9061705 tokens] test: stored fields.......OK [27927 total field count; avg 3 fields per= doc] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] 4 of 21: name=3D=5Fwe docCount=3D2420 compound=3Dtrue hasProx=3Dtrue numFiles=3D1 size (MB)=3D43.43 diagnostics =3D {os.arch=3Damd64, mergeDocStores=3Dtrue, java.vendor=3D= IBM Corporation, os=3DWindows Server 2008 R2, mergeFactor=3D10, source=3Dme= rge, java.version=3D1.6.0, lucene.version=3D3.0.3 1039909 - 2010-11-28 19:0= 8:19, optimize=3Dfalse, os.version=3D6.1 build 7601 Service Pack 1} no deletions test: open reader.........OK test: fields..............OK [7 fields] test: field norms.........OK [2 fields] test: terms, freq, prox...OK [94278 terms; 2483076 terms/docs pairs; 25= 656119 tokens] test: stored fields.......OK [7260 total field count; avg 3 fields per = doc] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] 5 of 21: name=3D=5Fwc docCount=3D77 compound=3Dtrue hasProx=3Dtrue numFiles=3D1 size (MB)=3D0.741 diagnostics =3D {os.arch=3Damd64, java.vendor=3DIBM Corporation, os=3DW= indows Server 2008 R2, source=3Dflush, java.version=3D1.6.0, lucene.version= =3D3.0.3 1039909 - 2010-11-28 19:08:19, os.version=3D6.1 build 7601 Service= Pack 1} no deletions test: open reader.........OK test: fields..............OK [7 fields] test: field norms.........OK [2 fields] test: terms, freq, prox...OK [7528 terms; 74337 terms/docs pairs; 35921= 1 tokens] test: stored fields.......OK [231 total field count; avg 3 fields per d= oc] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] 6 of 21: name=3D=5Fwd docCount=3D62 compound=3Dtrue hasProx=3Dtrue numFiles=3D1 size (MB)=3D8.042 diagnostics =3D {os.arch=3Damd64, java.vendor=3DIBM Corporation, os=3DW= indows Server 2008 R2, source=3Dflush, java.version=3D1.6.0, lucene.version= =3D3.0.3 1039909 - 2010-11-28 19:08:19, os.version=3D6.1 build 7601 Service= Pack 1} no deletions test: open reader.........OK test: fields..............OK [7 fields] test: field norms.........OK [2 fields] test: terms, freq, prox...OK [55645 terms; 112721 terms/docs pairs; 489= 6353 tokens] test: stored fields.......OK [186 total field count; avg 3 fields per d= oc] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] 7 of 21: name=3D=5Fwp docCount=3D180 compound=3Dtrue hasProx=3Dtrue numFiles=3D1 size (MB)=3D2.443 diagnostics =3D {os.arch=3Damd64, mergeDocStores=3Dtrue, java.vendor=3D= IBM Corporation, os=3DWindows Server 2008 R2, mergeFactor=3D10, source=3Dme= rge, java.version=3D1.6.0, lucene.version=3D3.0.3 1039909 - 2010-11-28 19:0= 8:19, optimize=3Dfalse, os.version=3D6.1 build 7601 Service Pack 1} no deletions test: open reader.........OK test: fields..............OK [7 fields] test: field norms.........OK [2 fields] test: terms, freq, prox...OK [16275 terms; 171479 terms/docs pairs; 132= 9084 tokens] test: stored fields.......OK [540 total field count; avg 3 fields per d= oc] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] 8 of 21: name=3D=5Fwq docCount=3D6 compound=3Dtrue hasProx=3Dtrue numFiles=3D1 size (MB)=3D0.059 diagnostics =3D {os.arch=3Damd64, java.vendor=3DIBM Corporation, os=3DW= indows Server 2008 R2, source=3Dflush, java.version=3D1.6.0, lucene.version= =3D3.0.3 1039909 - 2010-11-28 19:08:19, os.version=3D6.1 build 7601 Service= Pack 1} no deletions test: open reader.........OK test: fields..............OK [7 fields] test: field norms.........OK [2 fields] test: terms, freq, prox...OK [2131 terms; 5721 terms/docs pairs; 20329 = tokens] test: stored fields.......OK [18 total field count; avg 3 fields per do= c] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] 9 of 21: name=3D=5Fwr docCount=3D11 compound=3Dtrue hasProx=3Dtrue numFiles=3D1 size (MB)=3D0.732 diagnostics =3D {os.arch=3Damd64, java.vendor=3DIBM Corporation, os=3DW= indows Server 2008 R2, source=3Dflush, java.version=3D1.6.0, lucene.version= =3D3.0.3 1039909 - 2010-11-28 19:08:19, os.version=3D6.1 build 7601 Service= Pack 1} no deletions test: open reader.........OK test: fields..............OK [7 fields] test: field norms.........OK [2 fields] test: terms, freq, prox...OK [9378 terms; 18783 terms/docs pairs; 44358= 4 tokens] test: stored fields.......OK [33 total field count; avg 3 fields per do= c] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] 10 of 21: name=3D=5Fws docCount=3D5 compound=3Dtrue hasProx=3Dtrue numFiles=3D1 size (MB)=3D2.453 diagnostics =3D {os.arch=3Damd64, java.vendor=3DIBM Corporation, os=3DW= indows Server 2008 R2, source=3Dflush, java.version=3D1.6.0, lucene.version= =3D3.0.3 1039909 - 2010-11-28 19:08:19, os.version=3D6.1 build 7601 Service= Pack 1} no deletions test: open reader.........OK test: fields..............OK [7 fields] test: field norms.........OK [2 fields] test: terms, freq, prox...OK [11782 terms; 27913 terms/docs pairs; 1576= 033 tokens] test: stored fields.......OK [15 total field count; avg 3 fields per do= c] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] 11 of 21: name=3D=5Fx3 docCount=3D85 compound=3Dtrue hasProx=3Dtrue numFiles=3D1 size (MB)=3D0.543 diagnostics =3D {os.arch=3Damd64, mergeDocStores=3Dtrue, java.vendor=3D= IBM Corporation, os=3DWindows Server 2008 R2, mergeFactor=3D10, source=3Dme= rge, java.version=3D1.6.0, lucene.version=3D3.0.3 1039909 - 2010-11-28 19:0= 8:19, optimize=3Dfalse, os.version=3D6.1 build 7601 Service Pack 1} no deletions test: open reader.........OK test: fields..............OK [7 fields] test: field norms.........OK [2 fields] test: terms, freq, prox...OK [5082 terms; 68529 terms/docs pairs; 24140= 3 tokens] test: stored fields.......OK [255 total field count; avg 3 fields per d= oc] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] 12 of 21: name=3D=5Fx4 docCount=3D23 compound=3Dtrue hasProx=3Dtrue numFiles=3D1 size (MB)=3D0.141 diagnostics =3D {os.arch=3Damd64, java.vendor=3DIBM Corporation, os=3DW= indows Server 2008 R2, source=3Dflush, java.version=3D1.6.0, lucene.version= =3D3.0.3 1039909 - 2010-11-28 19:08:19, os.version=3D6.1 build 7601 Service= Pack 1} no deletions test: open reader.........OK test: fields..............OK [7 fields] test: field norms.........OK [2 fields] test: terms, freq, prox...OK [1990 terms; 17849 terms/docs pairs; 58751= tokens] test: stored fields.......OK [69 total field count; avg 3 fields per do= c] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] 13 of 21: name=3D=5Fx5 docCount=3D12 compound=3Dtrue hasProx=3Dtrue numFiles=3D1 size (MB)=3D0.086 diagnostics =3D {os.arch=3Damd64, java.vendor=3DIBM Corporation, os=3DW= indows Server 2008 R2, source=3Dflush, java.version=3D1.6.0, lucene.version= =3D3.0.3 1039909 - 2010-11-28 19:08:19, os.version=3D6.1 build 7601 Service= Pack 1} no deletions test: open reader.........OK test: fields..............OK [7 fields] test: field norms.........OK [2 fields] test: terms, freq, prox...OK [1622 terms; 10473 terms/docs pairs; 35431= tokens] test: stored fields.......OK [36 total field count; avg 3 fields per do= c] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] 14 of 21: name=3D=5Fx6 docCount=3D7 compound=3Dtrue hasProx=3Dtrue numFiles=3D1 size (MB)=3D0.053 diagnostics =3D {os.arch=3Damd64, java.vendor=3DIBM Corporation, os=3DW= indows Server 2008 R2, source=3Dflush, java.version=3D1.6.0, lucene.version= =3D3.0.3 1039909 - 2010-11-28 19:08:19, os.version=3D6.1 build 7601 Service= Pack 1} no deletions test: open reader.........OK test: fields..............OK [7 fields] test: field norms.........OK [2 fields] test: terms, freq, prox...OK [1236 terms; 5988 terms/docs pairs; 20532 = tokens] test: stored fields.......OK [21 total field count; avg 3 fields per do= c] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] 15 of 21: name=3D=5Fx7 docCount=3D28 compound=3Dtrue hasProx=3Dtrue numFiles=3D1 size (MB)=3D0.202 diagnostics =3D {os.arch=3Damd64, java.vendor=3DIBM Corporation, os=3DW= indows Server 2008 R2, source=3Dflush, java.version=3D1.6.0, lucene.version= =3D3.0.3 1039909 - 2010-11-28 19:08:19, os.version=3D6.1 build 7601 Service= Pack 1} no deletions test: open reader.........OK test: fields..............OK [7 fields] test: field norms.........OK [2 fields] test: terms, freq, prox...OK [2824 terms; 25213 terms/docs pairs; 86466= tokens] test: stored fields.......OK [84 total field count; avg 3 fields per do= c] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] 16 of 21: name=3D=5Fx8 docCount=3D22 compound=3Dtrue hasProx=3Dtrue numFiles=3D1 size (MB)=3D0.151 diagnostics =3D {os.arch=3Damd64, java.vendor=3DIBM Corporation, os=3DW= indows Server 2008 R2, source=3Dflush, java.version=3D1.6.0, lucene.version= =3D3.0.3 1039909 - 2010-11-28 19:08:19, os.version=3D6.1 build 7601 Service= Pack 1} no deletions test: open reader.........OK test: fields..............OK [7 fields] test: field norms.........OK [2 fields] test: terms, freq, prox...OK [2306 terms; 18537 terms/docs pairs; 62645= tokens] test: stored fields.......OK [66 total field count; avg 3 fields per do= c] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] 17 of 21: name=3D=5Fx9 docCount=3D14 compound=3Dtrue hasProx=3Dtrue numFiles=3D1 size (MB)=3D0.104 diagnostics =3D {os.arch=3Damd64, java.vendor=3DIBM Corporation, os=3DW= indows Server 2008 R2, source=3Dflush, java.version=3D1.6.0, lucene.version= =3D3.0.3 1039909 - 2010-11-28 19:08:19, os.version=3D6.1 build 7601 Service= Pack 1} no deletions test: open reader.........OK test: fields..............OK [7 fields] test: field norms.........OK [2 fields] test: terms, freq, prox...OK [2121 terms; 12472 terms/docs pairs; 42585= tokens] test: stored fields.......OK [42 total field count; avg 3 fields per do= c] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] 18 of 21: name=3D=5Fxa docCount=3D11 compound=3Dtrue hasProx=3Dtrue numFiles=3D1 size (MB)=3D0.084 diagnostics =3D {os.arch=3Damd64, java.vendor=3DIBM Corporation, os=3DW= indows Server 2008 R2, source=3Dflush, java.version=3D1.6.0, lucene.version= =3D3.0.3 1039909 - 2010-11-28 19:08:19, os.version=3D6.1 build 7601 Service= Pack 1} no deletions test: open reader.........OK test: fields..............OK [7 fields] test: field norms.........OK [2 fields] test: terms, freq, prox...OK [1789 terms; 9887 terms/docs pairs; 33684 = tokens] test: stored fields.......OK [33 total field count; avg 3 fields per do= c] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] 19 of 21: name=3D=5Fxb docCount=3D12 compound=3Dtrue hasProx=3Dtrue numFiles=3D1 size (MB)=3D0.093 diagnostics =3D {os.arch=3Damd64, java.vendor=3DIBM Corporation, os=3DW= indows Server 2008 R2, source=3Dflush, java.version=3D1.6.0, lucene.version= =3D3.0.3 1039909 - 2010-11-28 19:08:19, os.version=3D6.1 build 7601 Service= Pack 1} no deletions test: open reader.........FAILED WARNING: fixIndex() would remove reference to this segment; full except= ion: java.io.IOException: No sub-file with id =5Fxb.fnm found at org.apache.lucene.index.CompoundFileReader.openInput(CompoundFileReader= .java:137) at org.apache.lucene.index.CompoundFileReader.openInput(CompoundFileReader= .java:125) at org.apache.lucene.index.FieldInfos.(FieldInfos.java:68) at org.apache.lucene.index.SegmentReader$CoreReaders.(SegmentReader.= java:120) at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:605) at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:583) at org.apache.lucene.index.CheckIndex.checkIndex(CheckIndex.java:470) at org.apache.lucene.index.CheckIndex.main(CheckIndex.java:883) 20 of 21: name=3D=5Fxc docCount=3D7 compound=3Dtrue hasProx=3Dtrue numFiles=3D1 size (MB)=3D0.06 diagnostics =3D {os.arch=3Damd64, java.vendor=3DIBM Corporation, os=3DW= indows Server 2008 R2, source=3Dflush, java.version=3D1.6.0, lucene.version= =3D3.0.3 1039909 - 2010-11-28 19:08:19, os.version=3D6.1 build 7601 Service= Pack 1} no deletions test: open reader.........OK test: fields..............OK [7 fields] test: field norms.........OK [2 fields] test: terms, freq, prox...OK [1605 terms; 6529 terms/docs pairs; 22798 = tokens] test: stored fields.......OK [21 total field count; avg 3 fields per do= c] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] 21 of 21: name=3D=5Fxe docCount=3D15 compound=3Dtrue hasProx=3Dtrue numFiles=3D1 size (MB)=3D0.118 diagnostics =3D {os.arch=3Damd64, java.vendor=3DIBM Corporation, os=3DW= indows Server 2008 R2, source=3Dflush, java.version=3D1.6.0, lucene.version= =3D3.0.3 1039909 - 2010-11-28 19:08:19, os.version=3D6.1 build 7601 Service= Pack 1} no deletions test: open reader.........OK test: fields..............OK [7 fields] test: field norms.........OK [2 fields] test: terms, freq, prox...OK [2228 terms; 14122 terms/docs pairs; 49732= tokens] test: stored fields.......OK [45 total field count; avg 3 fields per do= c] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] WARNING: 2 broken segments (containing 17563 documents) detected WARNING: would write new segments file, and 17563 documents would be lost, = if -fix were specified --=_mixed 00354D32C2257DB1_= Content-Type: text/plain; name="checkIndexOutput_2.txt" Content-Disposition: attachment; filename="checkIndexOutput_2.txt" Content-Transfer-Encoding: quoted-printable Segments file=3Dsegments=5Fng numSegments=3D18 version=3DFORMAT=5FDIAGNOSTI= CS [Lucene 2.9] 1 of 18: name=3D=5Fap docCount=3D29262 compound=3Dfalse hasProx=3Dtrue numFiles=3D8 size (MB)=3D413.426 diagnostics =3D {os.arch=3Damd64, mergeDocStores=3Dtrue, java.vendor=3D= IBM Corporation, os=3DWindows Server 2008 R2, mergeFactor=3D10, source=3Dme= rge, java.version=3D1.6.0, lucene.version=3D3.0.3 1039909 - 2010-11-28 19:0= 8:19, optimize=3Dfalse, os.version=3D6.1 build 7601 Service Pack 1} no deletions test: open reader.........OK test: fields..............OK [11 fields] test: field norms.........OK [6 fields] test: terms, freq, prox...OK [399991 terms; 27579250 terms/docs pairs; = 245320046 tokens] test: stored fields.......OK [87786 total field count; avg 3 fields per= doc] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] 2 of 18: name=3D=5Fej docCount=3D6607 compound=3Dfalse hasProx=3Dtrue numFiles=3D8 size (MB)=3D86.332 diagnostics =3D {os.arch=3Damd64, mergeDocStores=3Dtrue, java.vendor=3D= IBM Corporation, os=3DWindows Server 2008 R2, mergeFactor=3D10, source=3Dme= rge, java.version=3D1.6.0, lucene.version=3D3.0.3 1039909 - 2010-11-28 19:0= 8:19, optimize=3Dfalse, os.version=3D6.1 build 7601 Service Pack 1} no deletions test: open reader.........OK test: fields..............OK [7 fields] test: field norms.........OK [2 fields] test: terms, freq, prox...OK [149415 terms; 6357186 terms/docs pairs; 4= 8851691 tokens] test: stored fields.......OK [19821 total field count; avg 3 fields per= doc] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] 3 of 18: name=3D=5Fjo docCount=3D9171 compound=3Dfalse hasProx=3Dtrue numFiles=3D8 size (MB)=3D128.155 diagnostics =3D {os.arch=3Damd64, mergeDocStores=3Dtrue, java.vendor=3D= IBM Corporation, os=3DWindows Server 2008 R2, mergeFactor=3D10, source=3Dme= rge, java.version=3D1.6.0, lucene.version=3D3.0.3 1039909 - 2010-11-28 19:0= 8:19, optimize=3Dfalse, os.version=3D6.1 build 7601 Service Pack 1} no deletions test: open reader.........OK test: fields..............OK [7 fields] test: field norms.........OK [2 fields] test: terms, freq, prox...OK [212269 terms; 8935967 terms/docs pairs; 7= 4287984 tokens] test: stored fields.......OK [27513 total field count; avg 3 fields per= doc] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] 4 of 18: name=3D=5Fl4 docCount=3D2051 compound=3Dtrue hasProx=3Dtrue numFiles=3D1 size (MB)=3D34.312 diagnostics =3D {os.arch=3Damd64, mergeDocStores=3Dtrue, java.vendor=3D= IBM Corporation, os=3DWindows Server 2008 R2, mergeFactor=3D10, source=3Dme= rge, java.version=3D1.6.0, lucene.version=3D3.0.3 1039909 - 2010-11-28 19:0= 8:19, optimize=3Dfalse, os.version=3D6.1 build 7601 Service Pack 1} no deletions test: open reader.........OK test: fields..............OK [7 fields] test: field norms.........OK [2 fields] test: terms, freq, prox...OK [84018 terms; 2036360 terms/docs pairs; 19= 835816 tokens] test: stored fields.......OK [6153 total field count; avg 3 fields per = doc] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] 5 of 18: name=3D=5Flp docCount=3D962 compound=3Dtrue hasProx=3Dtrue numFiles=3D1 size (MB)=3D17.458 diagnostics =3D {os.arch=3Damd64, mergeDocStores=3Dtrue, java.vendor=3D= IBM Corporation, os=3DWindows Server 2008 R2, mergeFactor=3D10, source=3Dme= rge, java.version=3D1.6.0, lucene.version=3D3.0.3 1039909 - 2010-11-28 19:0= 8:19, optimize=3Dfalse, os.version=3D6.1 build 7601 Service Pack 1} no deletions test: open reader.........OK test: fields..............OK [7 fields] test: field norms.........OK [2 fields] test: terms, freq, prox...OK [63511 terms; 965921 terms/docs pairs; 100= 22696 tokens] test: stored fields.......OK [2886 total field count; avg 3 fields per = doc] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] 6 of 18: name=3D=5Fm5 docCount=3D465 compound=3Dtrue hasProx=3Dtrue numFiles=3D1 size (MB)=3D10.21 diagnostics =3D {os.arch=3Damd64, mergeDocStores=3Dtrue, java.vendor=3D= IBM Corporation, os=3DWindows Server 2008 R2, mergeFactor=3D10, source=3Dme= rge, java.version=3D1.6.0, lucene.version=3D3.0.3 1039909 - 2010-11-28 19:0= 8:19, optimize=3Dfalse, os.version=3D6.1 build 7601 Service Pack 1} no deletions test: open reader.........OK test: fields..............OK [7 fields] test: field norms.........OK [2 fields] test: terms, freq, prox...OK [56395 terms; 454308 terms/docs pairs; 599= 0208 tokens] test: stored fields.......OK [1395 total field count; avg 3 fields per = doc] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] 7 of 18: name=3D=5Fmx docCount=3D1614 compound=3Dtrue hasProx=3Dtrue numFiles=3D1 size (MB)=3D15.174 diagnostics =3D {os.arch=3Damd64, mergeDocStores=3Dtrue, java.vendor=3D= IBM Corporation, os=3DWindows Server 2008 R2, mergeFactor=3D10, source=3Dme= rge, java.version=3D1.6.0, lucene.version=3D3.0.3 1039909 - 2010-11-28 19:0= 8:19, optimize=3Dfalse, os.version=3D6.1 build 7601 Service Pack 1} no deletions test: open reader.........OK test: fields..............OK [7 fields] test: field norms.........OK [2 fields] test: terms, freq, prox...OK [52261 terms; 1502991 terms/docs pairs; 77= 64416 tokens] test: stored fields.......OK [4842 total field count; avg 3 fields per = doc] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] 8 of 18: name=3D=5Fn7 docCount=3D557 compound=3Dtrue hasProx=3Dtrue numFiles=3D1 size (MB)=3D6.219 diagnostics =3D {os.arch=3Damd64, mergeDocStores=3Dtrue, java.vendor=3D= IBM Corporation, os=3DWindows Server 2008 R2, mergeFactor=3D10, source=3Dme= rge, java.version=3D1.6.0, lucene.version=3D3.0.3 1039909 - 2010-11-28 19:0= 8:19, optimize=3Dfalse, os.version=3D6.1 build 7601 Service Pack 1} no deletions test: open reader.........OK test: fields..............OK [7 fields] test: field norms.........OK [2 fields] test: terms, freq, prox...OK [30631 terms; 526271 terms/docs pairs; 345= 0519 tokens] test: stored fields.......OK [1671 total field count; avg 3 fields per = doc] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] 9 of 18: name=3D=5Fni docCount=3D507 compound=3Dtrue hasProx=3Dtrue numFiles=3D1 size (MB)=3D7.264 diagnostics =3D {os.arch=3Damd64, mergeDocStores=3Dtrue, java.vendor=3D= IBM Corporation, os=3DWindows Server 2008 R2, mergeFactor=3D10, source=3Dme= rge, java.version=3D1.6.0, lucene.version=3D3.0.3 1039909 - 2010-11-28 19:0= 8:19, optimize=3Dfalse, os.version=3D6.1 build 7601 Service Pack 1} no deletions test: open reader.........OK test: fields..............OK [7 fields] test: field norms.........OK [2 fields] test: terms, freq, prox...OK [38044 terms; 504757 terms/docs pairs; 389= 4247 tokens] test: stored fields.......OK [1521 total field count; avg 3 fields per = doc] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] 10 of 18: name=3D=5Fnf docCount=3D30 compound=3Dtrue hasProx=3Dtrue numFiles=3D1 size (MB)=3D0.234 diagnostics =3D {os.arch=3Damd64, java.vendor=3DIBM Corporation, os=3DW= indows Server 2008 R2, source=3Dflush, java.version=3D1.6.0, lucene.version= =3D3.0.3 1039909 - 2010-11-28 19:08:19, os.version=3D6.1 build 7601 Service= Pack 1} no deletions test: open reader.........OK test: fields..............OK [7 fields] test: field norms.........OK [2 fields] test: terms, freq, prox...OK [3687 terms; 27580 terms/docs pairs; 10066= 1 tokens] test: stored fields.......OK [90 total field count; avg 3 fields per do= c] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] 11 of 18: name=3D=5Fng docCount=3D41 compound=3Dtrue hasProx=3Dtrue numFiles=3D1 size (MB)=3D0.81 diagnostics =3D {os.arch=3Damd64, java.vendor=3DIBM Corporation, os=3DW= indows Server 2008 R2, source=3Dflush, java.version=3D1.6.0, lucene.version= =3D3.0.3 1039909 - 2010-11-28 19:08:19, os.version=3D6.1 build 7601 Service= Pack 1} no deletions test: open reader.........OK test: fields..............OK [7 fields] test: field norms.........OK [2 fields] test: terms, freq, prox...OK [9555 terms; 52066 terms/docs pairs; 43255= 6 tokens] test: stored fields.......OK [123 total field count; avg 3 fields per d= oc] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] 12 of 18: name=3D=5Fnh docCount=3D54 compound=3Dtrue hasProx=3Dtrue numFiles=3D1 size (MB)=3D2.296 diagnostics =3D {os.arch=3Damd64, java.vendor=3DIBM Corporation, os=3DW= indows Server 2008 R2, source=3Dflush, java.version=3D1.6.0, lucene.version= =3D3.0.3 1039909 - 2010-11-28 19:08:19, os.version=3D6.1 build 7601 Service= Pack 1} no deletions test: open reader.........OK test: fields..............OK [7 fields] test: field norms.........OK [2 fields] test: terms, freq, prox...OK [18563 terms; 59611 terms/docs pairs; 1528= 766 tokens] test: stored fields.......OK [162 total field count; avg 3 fields per d= oc] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] 13 of 18: name=3D=5Fnj docCount=3D48 compound=3Dtrue hasProx=3Dtrue numFiles=3D1 size (MB)=3D0.293 diagnostics =3D {os.arch=3Damd64, java.vendor=3DIBM Corporation, os=3DW= indows Server 2008 R2, source=3Dflush, java.version=3D1.6.0, lucene.version= =3D3.0.3 1039909 - 2010-11-28 19:08:19, os.version=3D6.1 build 7601 Service= Pack 1} no deletions test: open reader.........OK test: fields..............OK [7 fields] test: field norms.........OK [2 fields] test: terms, freq, prox...OK [2973 terms; 38256 terms/docs pairs; 12666= 4 tokens] test: stored fields.......OK [144 total field count; avg 3 fields per d= oc] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] 14 of 18: name=3D=5Fnk docCount=3D43 compound=3Dtrue hasProx=3Dtrue numFiles=3D1 size (MB)=3D0.297 diagnostics =3D {os.arch=3Damd64, java.vendor=3DIBM Corporation, os=3DW= indows Server 2008 R2, source=3Dflush, java.version=3D1.6.0, lucene.version= =3D3.0.3 1039909 - 2010-11-28 19:08:19, os.version=3D6.1 build 7601 Service= Pack 1} no deletions test: open reader.........OK test: fields..............OK [7 fields] test: field norms.........OK [2 fields] test: terms, freq, prox...OK [3387 terms; 37864 terms/docs pairs; 13040= 3 tokens] test: stored fields.......OK [129 total field count; avg 3 fields per d= oc] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] 15 of 18: name=3D=5Fnl docCount=3D36 compound=3Dtrue hasProx=3Dtrue numFiles=3D1 size (MB)=3D0.264 diagnostics =3D {os.arch=3Damd64, java.vendor=3DIBM Corporation, os=3DW= indows Server 2008 R2, source=3Dflush, java.version=3D1.6.0, lucene.version= =3D3.0.3 1039909 - 2010-11-28 19:08:19, os.version=3D6.1 build 7601 Service= Pack 1} no deletions test: open reader.........OK test: fields..............OK [7 fields] test: field norms.........OK [2 fields] test: terms, freq, prox...OK [3089 terms; 33007 terms/docs pairs; 11701= 4 tokens] test: stored fields.......OK [108 total field count; avg 3 fields per d= oc] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] 16 of 18: name=3D=5Fnm docCount=3D43 compound=3Dtrue hasProx=3Dtrue numFiles=3D1 size (MB)=3D0.305 diagnostics =3D {os.arch=3Damd64, java.vendor=3DIBM Corporation, os=3DW= indows Server 2008 R2, source=3Dflush, java.version=3D1.6.0, lucene.version= =3D3.0.3 1039909 - 2010-11-28 19:08:19, os.version=3D6.1 build 7601 Service= Pack 1} no deletions test: open reader.........OK test: fields..............OK [7 fields] test: field norms.........OK [2 fields] test: terms, freq, prox...OK [3452 terms; 39078 terms/docs pairs; 13458= 5 tokens] test: stored fields.......OK [129 total field count; avg 3 fields per d= oc] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] 17 of 18: name=3D=5Fnn docCount=3D47 compound=3Dtrue hasProx=3Dtrue numFiles=3D1 size (MB)=3D0.336 diagnostics =3D {os.arch=3Damd64, java.vendor=3DIBM Corporation, os=3DW= indows Server 2008 R2, source=3Dflush, java.version=3D1.6.0, lucene.version= =3D3.0.3 1039909 - 2010-11-28 19:08:19, os.version=3D6.1 build 7601 Service= Pack 1} no deletions test: open reader.........FAILED WARNING: fixIndex() would remove reference to this segment; full except= ion: java.io.IOException: No sub-file with id =5Fnn.fnm found at org.apache.lucene.index.CompoundFileReader.openInput(CompoundFileReader= .java:137) at org.apache.lucene.index.CompoundFileReader.openInput(CompoundFileReader= .java:125) at org.apache.lucene.index.FieldInfos.(FieldInfos.java:68) at org.apache.lucene.index.SegmentReader$CoreReaders.(SegmentReader.= java:120) at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:605) at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:583) at org.apache.lucene.index.CheckIndex.checkIndex(CheckIndex.java:470) at org.apache.lucene.index.CheckIndex.main(CheckIndex.java:883) 18 of 18: name=3D=5Fno docCount=3D66 compound=3Dtrue hasProx=3Dtrue numFiles=3D1 size (MB)=3D0.47 diagnostics =3D {os.arch=3Damd64, java.vendor=3DIBM Corporation, os=3DW= indows Server 2008 R2, source=3Dflush, java.version=3D1.6.0, lucene.version= =3D3.0.3 1039909 - 2010-11-28 19:08:19, os.version=3D6.1 build 7601 Service= Pack 1} no deletions test: open reader.........OK test: fields..............OK [7 fields] test: field norms.........OK [2 fields] test: terms, freq, prox...OK [4302 terms; 60712 terms/docs pairs; 21088= 4 tokens] test: stored fields.......OK [198 total field count; avg 3 fields per d= oc] test: term vectors........OK [0 total vector count; avg 0 term/freq vec= tor fields per doc] WARNING: 1 broken segments (containing 47 documents) detected WARNING: would write new segments file, and 47 documents would be lost, if = -fix were specified --=_mixed 00354D32C2257DB1_= Content-Type: text/plain; charset=us-ascii --------------------------------------------------------------------- To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org For additional commands, e-mail: java-user-help@lucene.apache.org --=_mixed 00354D32C2257DB1_=--