lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From alfredhong <ah...@proofpoint.com>
Subject IndexWriter loops trying to merge using ConcurrentMergeScheduler
Date Wed, 26 Oct 2011 17:05:00 GMT
This is with lucene 3.0.3 running JDK 6u20 64-bit.  

I'm running into an issue where merges are looping seemingly randomly with
the use of ConcurrentMergeSchduler.  By "seemingly randomly", I mean that
with repeated process restarts against very much the same data set this
behavior will occur, but it doesn't seem to be triggered by a specific
document, i.e. this is not caused by specific data.

The following is the DEBUG logging on IndexMerger.  Has anyone seen this
before or know what the issue is and the resolution for this?  Note that
using "merge: total" as a milestone marker, you'll see that the Merge Thread
#0 is looping repeatedly.


2011-10-25T23:27:36.791+0000	DEBUG	pool-9-thread-1
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:36 UTC 2011;
pool-9-thread-1]: setInfoStream:
dir=org.apache.lucene.store.NIOFSDirectory@/home/merger/25331545000616551-12
lockFactory=org.apache.lucene.store.NativeFSLockFactory@142c29ff
mergePolicy=org.apache.lucene.index.BalancedSegmentMergePolicy@5421b305
mergeScheduler=org.apache.lucene.index.ConcurrentMergeScheduler@70703869
ramBufferSizeMB=100.0 maxBufferedDocs=-1 maxBuffereDeleteTerms=-1
maxFieldLength=2147483647 index=
2011-10-25T23:27:36.795+0000	DEBUG	pool-9-thread-1
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:36 UTC 2011;
pool-9-thread-1]: flush at addIndexesNoOptimize
2011-10-25T23:27:36.795+0000	DEBUG	pool-9-thread-1
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:36 UTC 2011;
pool-9-thread-1]: flush: now pause all indexing threads
2011-10-25T23:27:36.796+0000	DEBUG	pool-9-thread-1
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:36 UTC 2011;
pool-9-thread-1]:   flush: segment=null docStoreSegment=null
docStoreOffset=0 flushDocs=false flushDeletes=true flushDocStores=false
numDocs=0 numBufDelTerms=0
2011-10-25T23:27:36.796+0000	DEBUG	pool-9-thread-1
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:36 UTC 2011;
pool-9-thread-1]:   index before flush 
2011-10-25T23:27:36.796+0000	DEBUG	pool-9-thread-1
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:36 UTC 2011;
pool-9-thread-1]: now start transaction
2011-10-25T23:27:36.803+0000	DEBUG	pool-9-thread-1
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:36 UTC 2011;
pool-9-thread-1]: add merge to pendingMerges: _0:Cx30877->_0 _0:Cx12519->_0
[total 1 pending]
2011-10-25T23:27:36.804+0000	DEBUG	pool-9-thread-1
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:36 UTC 2011;
pool-9-thread-1]: add merge to pendingMerges: _0:Cx28305->_0 _0:Cx19527->_0
[total 2 pending]
2011-10-25T23:27:36.804+0000	DEBUG	pool-9-thread-1
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:36 UTC 2011;
pool-9-thread-1]: add merge to pendingMerges: _0:Cx4605->_0 _0:Cx37050->_0
[total 3 pending]
2011-10-25T23:27:36.804+0000	DEBUG	pool-9-thread-1
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:36 UTC 2011;
pool-9-thread-1]: add merge to pendingMerges: _0:Cx30862->_0 _0:Cx16948->_0
[total 4 pending]
2011-10-25T23:27:36.804+0000	DEBUG	pool-9-thread-1
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:36 UTC 2011;
pool-9-thread-1]: add merge to pendingMerges: _0:Cx22130->_0 _0:Cx47560->_0
[total 5 pending]
2011-10-25T23:27:36.804+0000	DEBUG	pool-9-thread-1
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:36 UTC 2011;
pool-9-thread-1]: add merge to pendingMerges: _0:Cx11198->_0 _0:Cx53059->_0
[total 6 pending]
2011-10-25T23:27:36.804+0000	DEBUG	pool-9-thread-1
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:36 UTC 2011;
pool-9-thread-1]: CMS: now merge
2011-10-25T23:27:36.804+0000	DEBUG	pool-9-thread-1
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:36 UTC 2011;
pool-9-thread-1]: CMS:   index: _0:Cx11198->_0** _0:Cx53059->_0**
_0:Cx22130->_0** _0:Cx47560->_0** _0:Cx30862->_0** _0:Cx16948->_0**
_0:Cx30401->_0** _0:Cx36858->_0** _0:Cx37828->_0** _0:Cx4605->_0**
_0:Cx37050->_0** _0:Cx28305->_0** _0:Cx19527->_0** _2:Cx75008->_0**
_0:Cx30877->_0** _0:Cx12519->_0**
2011-10-25T23:27:36.804+0000	DEBUG	pool-9-thread-1
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:36 UTC 2011;
pool-9-thread-1]: CMS:   consider merge _0:Cx30877->_0 _0:Cx12519->_0 into
_0 [mergeDocStores]
2011-10-25T23:27:36.805+0000	DEBUG	pool-9-thread-1
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:36 UTC 2011;
pool-9-thread-1]: CMS:     launch new thread [Lucene Merge Thread #0]
2011-10-25T23:27:36.805+0000	DEBUG	pool-9-thread-1
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:36 UTC 2011;
pool-9-thread-1]: CMS:     too many merge threads running; stalling...
2011-10-25T23:27:36.805+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:36 UTC 2011;
Lucene Merge Thread #0]: CMS:   merge thread: start
2011-10-25T23:27:36.806+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:36 UTC 2011;
Lucene Merge Thread #0]: now merge
2011-10-25T23:27:36.806+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:36 UTC 2011;
Lucene Merge Thread #0]: merging _0:Cx30877->_0 _0:Cx12519->_0 into _0
[mergeDocStores]
2011-10-25T23:27:36.807+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:36 UTC 2011;
Lucene Merge Thread #0]: merge: *total 43396 docs*
2011-10-25T23:27:37.476+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:37 UTC 2011;
Lucene Merge Thread #0]: commitMerge: _0:Cx30877->_0 _0:Cx12519->_0 into _0
[mergeDocStores] index=_0:Cx11198->_0** _0:Cx53059->_0** _0:Cx22130->_0**
_0:Cx47560->_0** _0:Cx30862->_0** _0:Cx16948->_0** _0:Cx30401->_0**
_0:Cx36858->_0** _0:Cx37828->_0** _0:Cx4605->_0** _0:Cx37050->_0**
_0:Cx28305->_0** _0:Cx19527->_0** _2:Cx75008->_0** _0:Cx30877->_0**
_0:Cx12519->_0**
2011-10-25T23:27:37.476+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:37 UTC 2011;
Lucene Merge Thread #0]: commitMergeDeletes _0:Cx30877->_0 _0:Cx12519->_0
into _0 [mergeDocStores]
2011-10-25T23:27:37.476+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IFD [Tue Oct 25 23:27:37 UTC 2011;
Lucene Merge Thread #0]: now checkpoint "segments_1" [15 segments ; isCommit
= false]
2011-10-25T23:27:37.477+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:37 UTC 2011;
Lucene Merge Thread #0]: CMS:   merge thread: do another merge _0:Cx4605->_0
_0:Cx37050->_0 into _2 [mergeDocStores]
2011-10-25T23:27:37.477+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:37 UTC 2011;
Lucene Merge Thread #0]: now merge
2011-10-25T23:27:37.477+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:37 UTC 2011;
Lucene Merge Thread #0]: merging _0:Cx4605->_0 _0:Cx37050->_0 into _2
[mergeDocStores]
2011-10-25T23:27:37.478+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:37 UTC 2011;
Lucene Merge Thread #0]: *merge: total 41655 docs*
2011-10-25T23:27:38.071+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:38 UTC 2011;
Lucene Merge Thread #0]: commitMerge: _0:Cx4605->_0 _0:Cx37050->_0 into _2
[mergeDocStores] index=_0:Cx11198->_0** _0:Cx53059->_0** _0:Cx22130->_0**
_0:Cx47560->_0** _0:Cx30862->_0** _0:Cx16948->_0** _0:Cx30401->_0**
_0:Cx36858->_0** _0:Cx37828->_0** _0:Cx4605->_0** _0:Cx37050->_0**
_0:Cx28305->_0** _0:Cx19527->_0** _2:Cx75008->_0** _0:C43396
2011-10-25T23:27:38.072+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:38 UTC 2011;
Lucene Merge Thread #0]: commitMergeDeletes _0:Cx4605->_0 _0:Cx37050->_0
into _2 [mergeDocStores]
2011-10-25T23:27:38.072+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IFD [Tue Oct 25 23:27:38 UTC 2011;
Lucene Merge Thread #0]: now checkpoint "segments_1" [14 segments ; isCommit
= false]
2011-10-25T23:27:38.072+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:38 UTC 2011;
Lucene Merge Thread #0]: CMS:   merge thread: do another merge
_0:Cx30862->_0 _0:Cx16948->_0 into _3 [mergeDocStores]
2011-10-25T23:27:38.073+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:38 UTC 2011;
Lucene Merge Thread #0]: now merge
2011-10-25T23:27:38.073+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:38 UTC 2011;
Lucene Merge Thread #0]: merging _0:Cx30862->_0 _0:Cx16948->_0 into _3
[mergeDocStores]
2011-10-25T23:27:38.073+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:38 UTC 2011;
Lucene Merge Thread #0]: *merge: total 47810 docs*
2011-10-25T23:27:38.709+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:38 UTC 2011;
Lucene Merge Thread #0]: commitMerge: _0:Cx30862->_0 _0:Cx16948->_0 into _3
[mergeDocStores] index=_0:Cx11198->_0** _0:Cx53059->_0** _0:Cx22130->_0**
_0:Cx47560->_0** _0:Cx30862->_0** _0:Cx16948->_0** _0:Cx30401->_0**
_0:Cx36858->_0** _0:Cx37828->_0** _2:C41655 _0:Cx28305->_0**
_0:Cx19527->_0** _2:Cx75008->_0** _0:C43396
2011-10-25T23:27:38.709+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:38 UTC 2011;
Lucene Merge Thread #0]: commitMergeDeletes _0:Cx30862->_0 _0:Cx16948->_0
into _3 [mergeDocStores]
2011-10-25T23:27:38.709+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IFD [Tue Oct 25 23:27:38 UTC 2011;
Lucene Merge Thread #0]: now checkpoint "segments_1" [13 segments ; isCommit
= false]
2011-10-25T23:27:38.710+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:38 UTC 2011;
Lucene Merge Thread #0]: CMS:   merge thread: do another merge
_0:Cx22130->_0 _0:Cx47560->_0 into _4 [mergeDocStores]
2011-10-25T23:27:38.710+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:38 UTC 2011;
Lucene Merge Thread #0]: now merge
2011-10-25T23:27:38.710+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:38 UTC 2011;
Lucene Merge Thread #0]: merging _0:Cx22130->_0 _0:Cx47560->_0 into _4
[mergeDocStores]
2011-10-25T23:27:38.711+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:38 UTC 2011;
Lucene Merge Thread #0]: *merge: total 69690 docs*
2011-10-25T23:27:39.750+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:39 UTC 2011;
Lucene Merge Thread #0]: commitMerge: _0:Cx22130->_0 _0:Cx47560->_0 into _4
[mergeDocStores] index=_0:Cx11198->_0** _0:Cx53059->_0** _0:Cx22130->_0**
_0:Cx47560->_0** _3:C47810 _0:Cx30401->_0** _0:Cx36858->_0**
_0:Cx37828->_0** _2:C41655 _0:Cx28305->_0** _0:Cx19527->_0**
_2:Cx75008->_0** _0:C43396
2011-10-25T23:27:39.750+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:39 UTC 2011;
Lucene Merge Thread #0]: commitMergeDeletes _0:Cx22130->_0 _0:Cx47560->_0
into _4 [mergeDocStores]
2011-10-25T23:27:39.750+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IFD [Tue Oct 25 23:27:39 UTC 2011;
Lucene Merge Thread #0]: now checkpoint "segments_1" [12 segments ; isCommit
= false]
2011-10-25T23:27:39.751+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:39 UTC 2011;
Lucene Merge Thread #0]: CMS:   merge thread: do another merge
_0:Cx11198->_0 _0:Cx53059->_0 into _5 [mergeDocStores]
2011-10-25T23:27:39.751+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:39 UTC 2011;
Lucene Merge Thread #0]: now merge
2011-10-25T23:27:39.751+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:39 UTC 2011;
Lucene Merge Thread #0]: merging _0:Cx11198->_0 _0:Cx53059->_0 into _5
[mergeDocStores]
2011-10-25T23:27:39.752+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:39 UTC 2011;
Lucene Merge Thread #0]: *merge: total 64257 docs*
2011-10-25T23:27:40.770+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:40 UTC 2011;
Lucene Merge Thread #0]: commitMerge: _0:Cx11198->_0 _0:Cx53059->_0 into _5
[mergeDocStores] index=_0:Cx11198->_0** _0:Cx53059->_0** _4:C69690 _3:C47810
_0:Cx30401->_0** _0:Cx36858->_0** _0:Cx37828->_0** _2:C41655
_0:Cx28305->_0** _0:Cx19527->_0** _2:Cx75008->_0** _0:C43396
2011-10-25T23:27:40.771+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:40 UTC 2011;
Lucene Merge Thread #0]: commitMergeDeletes _0:Cx11198->_0 _0:Cx53059->_0
into _5 [mergeDocStores]
2011-10-25T23:27:40.771+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IFD [Tue Oct 25 23:27:40 UTC 2011;
Lucene Merge Thread #0]: now checkpoint "segments_1" [11 segments ; isCommit
= false]
2011-10-25T23:27:40.771+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:40 UTC 2011;
Lucene Merge Thread #0]: add merge to pendingMerges: _0:C43396 [total 1
pending]
2011-10-25T23:27:40.771+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:40 UTC 2011;
Lucene Merge Thread #0]: CMS:   merge thread: do another merge _0:C43396
into _6 [mergeDocStores]
2011-10-25T23:27:40.771+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:40 UTC 2011;
Lucene Merge Thread #0]: now merge
2011-10-25T23:27:40.771+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:40 UTC 2011;
Lucene Merge Thread #0]: merging _0:C43396 into _6 [mergeDocStores]
2011-10-25T23:27:40.772+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:40 UTC 2011;
Lucene Merge Thread #0]: *merge: total 43396 docs*
2011-10-25T23:27:41.384+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:41 UTC 2011;
Lucene Merge Thread #0]: commitMerge: _0:C43396 into _6 [mergeDocStores]
index=_5:C64257 _4:C69690 _3:C47810 _0:Cx30401->_0** _0:Cx36858->_0**
_0:Cx37828->_0** _2:C41655 _0:Cx28305->_0** _0:Cx19527->_0**
_2:Cx75008->_0** _0:C43396
2011-10-25T23:27:41.384+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:41 UTC 2011;
Lucene Merge Thread #0]: commitMergeDeletes _0:C43396 into _6
[mergeDocStores]
2011-10-25T23:27:41.384+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IFD [Tue Oct 25 23:27:41 UTC 2011;
Lucene Merge Thread #0]: now checkpoint "segments_1" [11 segments ; isCommit
= false]
2011-10-25T23:27:41.384+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IFD [Tue Oct 25 23:27:41 UTC 2011;
Lucene Merge Thread #0]: delete "_0.tis"
2011-10-25T23:27:41.386+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IFD [Tue Oct 25 23:27:41 UTC 2011;
Lucene Merge Thread #0]: delete "_0.prx"
2011-10-25T23:27:41.387+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IFD [Tue Oct 25 23:27:41 UTC 2011;
Lucene Merge Thread #0]: delete "_0.nrm"
2011-10-25T23:27:41.387+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IFD [Tue Oct 25 23:27:41 UTC 2011;
Lucene Merge Thread #0]: delete "_0.fnm"
2011-10-25T23:27:41.387+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IFD [Tue Oct 25 23:27:41 UTC 2011;
Lucene Merge Thread #0]: delete "_0.tii"
2011-10-25T23:27:41.387+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IFD [Tue Oct 25 23:27:41 UTC 2011;
Lucene Merge Thread #0]: delete "_0.frq"
2011-10-25T23:27:41.389+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IFD [Tue Oct 25 23:27:41 UTC 2011;
Lucene Merge Thread #0]: delete "_0.fdx"
2011-10-25T23:27:41.389+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IFD [Tue Oct 25 23:27:41 UTC 2011;
Lucene Merge Thread #0]: delete "_0.fdt"
2011-10-25T23:27:41.394+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:41 UTC 2011;
Lucene Merge Thread #0]: add merge to pendingMerges: _6:C43396 [total 1
pending]
2011-10-25T23:27:41.395+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:41 UTC 2011;
Lucene Merge Thread #0]: CMS:   merge thread: do another merge _6:C43396
into _7 [mergeDocStores]
2011-10-25T23:27:41.395+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:41 UTC 2011;
Lucene Merge Thread #0]: now merge
2011-10-25T23:27:41.395+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:41 UTC 2011;
Lucene Merge Thread #0]: merging _6:C43396 into _7 [mergeDocStores]
2011-10-25T23:27:41.395+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:41 UTC 2011;
Lucene Merge Thread #0]: *merge: total 43396 docs*
2011-10-25T23:27:42.012+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:42 UTC 2011;
Lucene Merge Thread #0]: commitMerge: _6:C43396 into _7 [mergeDocStores]
index=_5:C64257 _4:C69690 _3:C47810 _0:Cx30401->_0** _0:Cx36858->_0**
_0:Cx37828->_0** _2:C41655 _0:Cx28305->_0** _0:Cx19527->_0**
_2:Cx75008->_0** _6:C43396
2011-10-25T23:27:42.030+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:42 UTC 2011;
Lucene Merge Thread #0]: commitMergeDeletes _6:C43396 into _7
[mergeDocStores]
2011-10-25T23:27:42.030+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IFD [Tue Oct 25 23:27:42 UTC 2011;
Lucene Merge Thread #0]: now checkpoint "segments_1" [11 segments ; isCommit
= false]
2011-10-25T23:27:42.030+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IFD [Tue Oct 25 23:27:42 UTC 2011;
Lucene Merge Thread #0]: delete "_6.frq"
2011-10-25T23:27:42.032+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IFD [Tue Oct 25 23:27:42 UTC 2011;
Lucene Merge Thread #0]: delete "_6.fdx"
2011-10-25T23:27:42.032+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IFD [Tue Oct 25 23:27:42 UTC 2011;
Lucene Merge Thread #0]: delete "_6.tis"
2011-10-25T23:27:42.035+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IFD [Tue Oct 25 23:27:42 UTC 2011;
Lucene Merge Thread #0]: delete "_6.tii"
2011-10-25T23:27:42.035+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IFD [Tue Oct 25 23:27:42 UTC 2011;
Lucene Merge Thread #0]: delete "_6.prx"
2011-10-25T23:27:42.036+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IFD [Tue Oct 25 23:27:42 UTC 2011;
Lucene Merge Thread #0]: delete "_6.fnm"
2011-10-25T23:27:42.036+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IFD [Tue Oct 25 23:27:42 UTC 2011;
Lucene Merge Thread #0]: delete "_6.fdt"
2011-10-25T23:27:42.043+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IFD [Tue Oct 25 23:27:42 UTC 2011;
Lucene Merge Thread #0]: delete "_6.nrm"
2011-10-25T23:27:42.043+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:42 UTC 2011;
Lucene Merge Thread #0]: add merge to pendingMerges: _7:C43396 [total 1
pending]
2011-10-25T23:27:42.043+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:42 UTC 2011;
Lucene Merge Thread #0]: CMS:   merge thread: do another merge _7:C43396
into _8 [mergeDocStores]
2011-10-25T23:27:42.043+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:42 UTC 2011;
Lucene Merge Thread #0]: now merge
2011-10-25T23:27:42.044+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:42 UTC 2011;
Lucene Merge Thread #0]: merging _7:C43396 into _8 [mergeDocStores]
2011-10-25T23:27:42.044+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:42 UTC 2011;
Lucene Merge Thread #0]: *merge: total 43396 docs*
2011-10-25T23:27:43.958+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:43 UTC 2011;
Lucene Merge Thread #0]: commitMerge: _7:C43396 into _8 [mergeDocStores]
index=_5:C64257 _4:C69690 _3:C47810 _0:Cx30401->_0** _0:Cx36858->_0**
_0:Cx37828->_0** _2:C41655 _0:Cx28305->_0** _0:Cx19527->_0**
_2:Cx75008->_0** _7:C43396
2011-10-25T23:27:43.958+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:43 UTC 2011;
Lucene Merge Thread #0]: commitMergeDeletes _7:C43396 into _8
[mergeDocStores]
2011-10-25T23:27:43.959+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IFD [Tue Oct 25 23:27:43 UTC 2011;
Lucene Merge Thread #0]: now checkpoint "segments_1" [11 segments ; isCommit
= false]
2011-10-25T23:27:43.959+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IFD [Tue Oct 25 23:27:43 UTC 2011;
Lucene Merge Thread #0]: delete "_7.fnm"
2011-10-25T23:27:43.959+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IFD [Tue Oct 25 23:27:43 UTC 2011;
Lucene Merge Thread #0]: delete "_7.tis"
2011-10-25T23:27:43.963+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IFD [Tue Oct 25 23:27:43 UTC 2011;
Lucene Merge Thread #0]: delete "_7.nrm"
2011-10-25T23:27:43.963+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IFD [Tue Oct 25 23:27:43 UTC 2011;
Lucene Merge Thread #0]: delete "_7.frq"
2011-10-25T23:27:43.965+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IFD [Tue Oct 25 23:27:43 UTC 2011;
Lucene Merge Thread #0]: delete "_7.tii"
2011-10-25T23:27:43.965+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IFD [Tue Oct 25 23:27:43 UTC 2011;
Lucene Merge Thread #0]: delete "_7.fdx"
2011-10-25T23:27:43.965+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IFD [Tue Oct 25 23:27:43 UTC 2011;
Lucene Merge Thread #0]: delete "_7.fdt"
2011-10-25T23:27:43.975+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IFD [Tue Oct 25 23:27:43 UTC 2011;
Lucene Merge Thread #0]: delete "_7.prx"
2011-10-25T23:27:43.976+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:43 UTC 2011;
Lucene Merge Thread #0]: add merge to pendingMerges: _8:C43396 [total 1
pending]
2011-10-25T23:27:43.977+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:43 UTC 2011;
Lucene Merge Thread #0]: CMS:   merge thread: do another merge _8:C43396
into _9 [mergeDocStores]
2011-10-25T23:27:43.977+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:43 UTC 2011;
Lucene Merge Thread #0]: now merge
2011-10-25T23:27:43.977+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:43 UTC 2011;
Lucene Merge Thread #0]: merging _8:C43396 into _9 [mergeDocStores]
2011-10-25T23:27:43.977+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:27:43 UTC 2011;
Lucene Merge Thread #0]: *merge: total 43396 docs*
2011-10-25T23:59:53.355+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:59:53 UTC 2011;
Lucene Merge Thread #0]: commitMerge: _24m:C43396 into _24n [mergeDocStores]
index=_5:C64257 _4:C69690 _3:C47810 _0:Cx30401->_0** _0:Cx36858->_0**
_0:Cx37828->_0** _2:C41655 _0:Cx28305->_0** _0:Cx19527->_0**
_2:Cx75008->_0** _24m:C43396
2011-10-25T23:59:53.355+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:59:53 UTC 2011;
Lucene Merge Thread #0]: commitMergeDeletes _24m:C43396 into _24n
[mergeDocStores]
2011-10-25T23:59:53.355+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IFD [Tue Oct 25 23:59:53 UTC 2011;
Lucene Merge Thread #0]: now checkpoint "segments_1" [11 segments ; isCommit
= false]
2011-10-25T23:59:53.355+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IFD [Tue Oct 25 23:59:53 UTC 2011;
Lucene Merge Thread #0]: delete "_24m.tis"
2011-10-25T23:59:53.358+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IFD [Tue Oct 25 23:59:53 UTC 2011;
Lucene Merge Thread #0]: delete "_24m.nrm"
2011-10-25T23:59:53.358+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IFD [Tue Oct 25 23:59:53 UTC 2011;
Lucene Merge Thread #0]: delete "_24m.tii"
2011-10-25T23:59:53.358+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IFD [Tue Oct 25 23:59:53 UTC 2011;
Lucene Merge Thread #0]: delete "_24m.fdt"
2011-10-25T23:59:53.367+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IFD [Tue Oct 25 23:59:53 UTC 2011;
Lucene Merge Thread #0]: delete "_24m.fnm"
2011-10-25T23:59:53.367+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IFD [Tue Oct 25 23:59:53 UTC 2011;
Lucene Merge Thread #0]: delete "_24m.frq"
2011-10-25T23:59:53.369+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IFD [Tue Oct 25 23:59:53 UTC 2011;
Lucene Merge Thread #0]: delete "_24m.fdx"
2011-10-25T23:59:53.369+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IFD [Tue Oct 25 23:59:53 UTC 2011;
Lucene Merge Thread #0]: delete "_24m.prx"
2011-10-25T23:59:53.370+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:59:53 UTC 2011;
Lucene Merge Thread #0]: add merge to pendingMerges: _24n:C43396 [total 1
pending]
2011-10-25T23:59:53.370+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:59:53 UTC 2011;
Lucene Merge Thread #0]: CMS:   merge thread: do another merge _24n:C43396
into _24o [mergeDocStores]
2011-10-25T23:59:53.370+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:59:53 UTC 2011;
Lucene Merge Thread #0]: now merge
2011-10-25T23:59:53.370+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:59:53 UTC 2011;
Lucene Merge Thread #0]: merging _24n:C43396 into _24o [mergeDocStores]
2011-10-25T23:59:53.371+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:59:53 UTC 2011;
Lucene Merge Thread #0]: *merge: total 43396 docs*
2011-10-25T23:59:59.071+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IFD [Tue Oct 25 23:59:59 UTC 2011;
Lucene Merge Thread #0]: delete "_24u.tis"
2011-10-25T23:59:59.074+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IFD [Tue Oct 25 23:59:59 UTC 2011;
Lucene Merge Thread #0]: delete "_24u.prx"
2011-10-25T23:59:59.075+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IFD [Tue Oct 25 23:59:59 UTC 2011;
Lucene Merge Thread #0]: delete "_24u.fdt"
2011-10-25T23:59:59.083+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IFD [Tue Oct 25 23:59:59 UTC 2011;
Lucene Merge Thread #0]: delete "_24u.fnm"
2011-10-25T23:59:59.083+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IFD [Tue Oct 25 23:59:59 UTC 2011;
Lucene Merge Thread #0]: delete "_24u.frq"
2011-10-25T23:59:59.085+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IFD [Tue Oct 25 23:59:59 UTC 2011;
Lucene Merge Thread #0]: delete "_24u.fdx"
2011-10-25T23:59:59.085+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IFD [Tue Oct 25 23:59:59 UTC 2011;
Lucene Merge Thread #0]: delete "_24u.tii"
2011-10-25T23:59:59.085+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IFD [Tue Oct 25 23:59:59 UTC 2011;
Lucene Merge Thread #0]: delete "_24u.nrm"
2011-10-25T23:59:59.086+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:59:59 UTC 2011;
Lucene Merge Thread #0]: add merge to pendingMerges: _24v:C43396 [total 1
pending]
2011-10-25T23:59:59.086+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:59:59 UTC 2011;
Lucene Merge Thread #0]: CMS:   merge thread: do another merge _24v:C43396
into _24w [mergeDocStores]
2011-10-25T23:59:59.086+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:59:59 UTC 2011;
Lucene Merge Thread #0]: now merge
2011-10-25T23:59:59.086+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:59:59 UTC 2011;
Lucene Merge Thread #0]: merging _24v:C43396 into _24w [mergeDocStores]
2011-10-25T23:59:59.086+0000	DEBUG	Lucene Merge Thread #0
org.apache.lucene.index.IndexWriter	IW 15 [Tue Oct 25 23:59:59 UTC 2011;
Lucene Merge Thread #0]: *merge: total 43396 docs*


--
View this message in context: http://lucene.472066.n3.nabble.com/IndexWriter-loops-trying-to-merge-using-ConcurrentMergeScheduler-tp3455163p3455163.html
Sent from the Lucene - Java Users mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


Mime
View raw message