lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jake Brownell <ja...@Benetech.org>
Subject RE: Corrupted Index
Date Thu, 07 Jan 2010 20:19:56 GMT
Yes, that would be helpful to include, sorry, the official 1.4.

-----Original Message-----
From: Ryan McKinley [mailto:ryantxu@gmail.com] 
Sent: Thursday, January 07, 2010 2:15 PM
To: solr-user@lucene.apache.org
Subject: Re: Corrupted Index

what version of solr are you running?


On Jan 7, 2010, at 3:08 PM, Jake Brownell wrote:

> Hi all,
>
> Our application uses solrj to communicate with our solr servers. We  
> started a fresh index yesterday after upping the maxFieldLength  
> setting in solrconfig. Our task indexes content in batches and all  
> appeared to be well until noonish today, when after 40k docs, I  
> started seeing errors. I've placed three stack traces below, the  
> first occurred once and was the initial error, the second occurred a  
> few times before the third started occurring on each request. I'd  
> really appreciate any insight into what could have caused this, a  
> missing file and then a corrupt index. If you know we'll have to  
> nuke the entire index and start over I'd like to know that too-oddly  
> enough searches against the index appear to be working.
>
> Thanks!
> Jake
>
> #1
>
> January 7, 2010 12:10:06 PM CST Caught error; TaskWrapper block 1
> January 7, 2010 12:10:07 PM CST solr-home/core0/data/index/ 
> _fsk_1uj.del (No such file or directory)
>
> solr-home/core0/data/index/_fsk_1uj.del (No such file or directory)
>
> request: /core0/update solr-home/core0/data/index/_fsk_1uj.del (No  
> such file or directory)
>
> solr-home/core0/data/index/_fsk_1uj.del (No such file or directory)
>
> request: /core0/update
> January 7, 2010 12:10:07 PM CST solr-home/core0/data/index/ 
> _fsk_1uj.del (No such file or directory)
>
> solr-home/core0/data/index/_fsk_1uj.del (No such file or directory)
>
> request: /core0/update solr-home/core0/data/index/_fsk_1uj.del (No  
> such file or directory)
>
> solr-home/core0/data/index/_fsk_1uj.del (No such file or directory)
>
> request: /core0/update
> org.benetech.exception.WrappedException           
> org.apache.solr.client.solrj.impl.CommonsHttpSolrServer#request(424)
>             
> org.apache.solr.client.solrj.impl.CommonsHttpSolrServer#request(243)
>             
> org 
> .apache.solr.client.solrj.request.AbstractUpdateRequest#process(105)
>            org.apache.solr.client.solrj.SolrServer#commit(86)
>            org.apache.solr.client.solrj.SolrServer#commit(75)
>            org.bookshare.search.solr.SolrSearchServerWrapper#add(63)
>            org.bookshare.search.solr.SolrSearchEngine#index(232)
>             
> org 
> .bookshare 
> .service.task.SearchEngineIndexingTask#initialInstanceLoad(95)
>            org.bookshare.service.task.SearchEngineIndexingTask#run(53)
>            org.bookshare.service.scheduler.TaskWrapper#run(233)
>            java.util.TimerThread#mainLoop(512)
>            java.util.TimerThread#run(462)
> Caused by:
> solr-home/core0/data/index/_fsk_1uj.del (No such file or directory)
>
> solr-home/core0/data/index/_fsk_1uj.del (No such file or directory)
>
> request: /core0/update
> org.apache.solr.common.SolrException    
> org.apache.solr.client.solrj.impl.CommonsHttpSolrServer#request(424)
>             
> org.apache.solr.client.solrj.impl.CommonsHttpSolrServer#request(243)
>             
> org 
> .apache.solr.client.solrj.request.AbstractUpdateRequest#process(105)
>            org.apache.solr.client.solrj.SolrServer#commit(86)
>            org.apache.solr.client.solrj.SolrServer#commit(75)
>            org.bookshare.search.solr.SolrSearchServerWrapper#add(63)
>            org.bookshare.search.solr.SolrSearchEngine#index(232)
>             
> org 
> .bookshare 
> .service.task.SearchEngineIndexingTask#initialInstanceLoad(95)
>            org.bookshare.service.task.SearchEngineIndexingTask#run(53)
>            org.bookshare.service.scheduler.TaskWrapper#run(233)
>            java.util.TimerThread#mainLoop(512)
>            java.util.TimerThread#run(462)
>
> #2
>
> January 7, 2010 12:10:10 PM CST Caught error; TaskWrapper block 1
> January 7, 2010 12:10:10 PM CST  
> org.apache.lucene.index.CorruptIndexException: doc counts differ for  
> segment _hug: fieldsReader shows 8 but segmentInfo shows 2
>
> org.apache.lucene.index.CorruptIndexException: doc counts differ for  
> segment _hug: fieldsReader shows 8 but segmentInfo shows 2
>
> request: /core0/update  
> org.apache.lucene.index.CorruptIndexException: doc counts differ for  
> segment _hug: fieldsReader shows 8 but segmentInfo shows 2
>
> org.apache.lucene.index.CorruptIndexException: doc counts differ for  
> segment _hug: fieldsReader shows 8 but segmentInfo shows 2
>
> request: /core0/update
> January 7, 2010 12:10:10 PM CST  
> org.apache.lucene.index.CorruptIndexException: doc counts differ for  
> segment _hug: fieldsReader shows 8 but segmentInfo shows 2
>
> org.apache.lucene.index.CorruptIndexException: doc counts differ for  
> segment _hug: fieldsReader shows 8 but segmentInfo shows 2
>
> request: /core0/update  
> org.apache.lucene.index.CorruptIndexException: doc counts differ for  
> segment _hug: fieldsReader shows 8 but segmentInfo shows 2
>
> org.apache.lucene.index.CorruptIndexException: doc counts differ for  
> segment _hug: fieldsReader shows 8 but segmentInfo shows 2
>
> request: /core0/update
> org.benetech.exception.WrappedException           
> org.apache.solr.client.solrj.impl.CommonsHttpSolrServer#request(424)
>             
> org.apache.solr.client.solrj.impl.CommonsHttpSolrServer#request(243)
>             
> org 
> .apache.solr.client.solrj.request.AbstractUpdateRequest#process(105)
>            org.apache.solr.client.solrj.SolrServer#commit(86)
>            org.apache.solr.client.solrj.SolrServer#commit(75)
>            org.bookshare.search.solr.SolrSearchServerWrapper#add(63)
>            org.bookshare.search.solr.SolrSearchEngine#index(232)
>             
> org 
> .bookshare 
> .service.task.SearchEngineIndexingTask#initialInstanceLoad(95)
>            org.bookshare.service.task.SearchEngineIndexingTask#run(53)
>            org.bookshare.service.scheduler.TaskWrapper#run(233)
>            java.util.TimerThread#mainLoop(512)
>            java.util.TimerThread#run(462)
> Caused by:
> org.apache.lucene.index.CorruptIndexException: doc counts differ for  
> segment _hug: fieldsReader shows 8 but segmentInfo shows 2
>
> org.apache.lucene.index.CorruptIndexException: doc counts differ for  
> segment _hug: fieldsReader shows 8 but segmentInfo shows 2
>
> request: /core0/update
> org.apache.solr.common.SolrException    
> org.apache.solr.client.solrj.impl.CommonsHttpSolrServer#request(424)
>             
> org.apache.solr.client.solrj.impl.CommonsHttpSolrServer#request(243)
>             
> org 
> .apache.solr.client.solrj.request.AbstractUpdateRequest#process(105)
>            org.apache.solr.client.solrj.SolrServer#commit(86)
>            org.apache.solr.client.solrj.SolrServer#commit(75)
>            org.bookshare.search.solr.SolrSearchServerWrapper#add(63)
>            org.bookshare.search.solr.SolrSearchEngine#index(232)
>             
> org 
> .bookshare 
> .service.task.SearchEngineIndexingTask#initialInstanceLoad(95)
>            org.bookshare.service.task.SearchEngineIndexingTask#run(53)
>            org.bookshare.service.scheduler.TaskWrapper#run(233)
>            java.util.TimerThread#mainLoop(512)
>            java.util.TimerThread#run(462)
>
>
> #3
>
>
> January 7, 2010 12:10:21 PM CST Caught error; TaskWrapper block 1
> January 7, 2010 12:10:21 PM CST Array index out of range: 7
>
> Array index out of range: 7
>
> request: /core0/update Array index out of range: 7
>
> Array index out of range: 7
>
> request: /core0/update
> January 7, 2010 12:10:21 PM CST Array index out of range: 7
>
> Array index out of range: 7
>
> request: /core0/update Array index out of range: 7
>
> Array index out of range: 7
>
> request: /core0/update
> org.benetech.exception.WrappedException           
> org.apache.solr.client.solrj.impl.CommonsHttpSolrServer#request(424)
>             
> org.apache.solr.client.solrj.impl.CommonsHttpSolrServer#request(243)
>             
> org 
> .apache.solr.client.solrj.request.AbstractUpdateRequest#process(105)
>            org.apache.solr.client.solrj.SolrServer#commit(86)
>            org.apache.solr.client.solrj.SolrServer#commit(75)
>            org.bookshare.search.solr.SolrSearchServerWrapper#add(63)
>            org.bookshare.search.solr.SolrSearchEngine#index(232)
>             
> org 
> .bookshare 
> .service.task.SearchEngineIndexingTask#initialInstanceLoad(95)
>            org.bookshare.service.task.SearchEngineIndexingTask#run(53)
>            org.bookshare.service.scheduler.TaskWrapper#run(233)
>            java.util.TimerThread#mainLoop(512)
>            java.util.TimerThread#run(462)
> Caused by:
> Array index out of range: 7
>
> Array index out of range: 7
>
> request: /core0/update
> org.apache.solr.common.SolrException    
> org.apache.solr.client.solrj.impl.CommonsHttpSolrServer#request(424)
>             
> org.apache.solr.client.solrj.impl.CommonsHttpSolrServer#request(243)
>             
> org 
> .apache.solr.client.solrj.request.AbstractUpdateRequest#process(105)
>            org.apache.solr.client.solrj.SolrServer#commit(86)
>            org.apache.solr.client.solrj.SolrServer#commit(75)
>            org.bookshare.search.solr.SolrSearchServerWrapper#add(63)
>            org.bookshare.search.solr.SolrSearchEngine#index(232)
>             
> org 
> .bookshare 
> .service.task.SearchEngineIndexingTask#initialInstanceLoad(95)
>            org.bookshare.service.task.SearchEngineIndexingTask#run(53)
>            org.bookshare.service.scheduler.TaskWrapper#run(233)
>            java.util.TimerThread#mainLoop(512)
>            java.util.TimerThread#run(462)
>


Mime
View raw message