Return-Path: Delivered-To: apmail-lucene-java-user-archive@www.apache.org Received: (qmail 1264 invoked from network); 10 Sep 2009 23:50:16 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 10 Sep 2009 23:50:16 -0000 Received: (qmail 81662 invoked by uid 500); 10 Sep 2009 23:50:13 -0000 Delivered-To: apmail-lucene-java-user-archive@lucene.apache.org Received: (qmail 81562 invoked by uid 500); 10 Sep 2009 23:50:13 -0000 Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: java-user@lucene.apache.org Delivered-To: mailing list java-user@lucene.apache.org Received: (qmail 81552 invoked by uid 99); 10 Sep 2009 23:50:13 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 10 Sep 2009 23:50:13 +0000 X-ASF-Spam-Status: No, hits=1.2 required=10.0 tests=SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (athena.apache.org: local policy) Received: from [209.85.211.191] (HELO mail-yw0-f191.google.com) (209.85.211.191) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 10 Sep 2009 23:50:05 +0000 Received: by ywh29 with SMTP id 29so932532ywh.23 for ; Thu, 10 Sep 2009 16:49:44 -0700 (PDT) MIME-Version: 1.0 Received: by 10.150.44.24 with SMTP id r24mr3709564ybr.249.1252626584304; Thu, 10 Sep 2009 16:49:44 -0700 (PDT) In-Reply-To: <85d3c3b60909101619x401c39a1wc4abb551b35a97b1@mail.gmail.com> References: <85d3c3b60909101619x401c39a1wc4abb551b35a97b1@mail.gmail.com> Date: Thu, 10 Sep 2009 19:49:44 -0400 Message-ID: <9ac0c6aa0909101649t5ca87f77r8c8525db52d38bf1@mail.gmail.com> Subject: Re: Index docstore flush problem From: Michael McCandless To: java-user@lucene.apache.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Virus-Checked: Checked by ClamAV on apache.org That's an odd exception. It means IndexWriter thinks 468 docs have been written to the stored fields file, which should mean the fdx file size is 3748 (=3D 4 + 468*8), yet the file size is far larger than that (298404). How repeatable is it? Can you turn on infoStream, get the exception to happen, then post the resulting output? Mike On Thu, Sep 10, 2009 at 7:19 PM, Jason Rutherglen wrote: > I'm seeing a strange exception when indexing using the latest Solr rev on= EC2. > > org.apache.solr.client.solrj.SolrServerException: > org.apache.solr.client.solrj.SolrServerException: > java.lang.RuntimeException: after flush: fdx size mismatch: 468 docs > vs 298404 length in bytes of _0.fdx > =A0 =A0 =A0 =A0at org.apache.solr.client.solrj.embedded.EmbeddedSolrServe= r.request(EmbeddedSolrServer.java:153) > =A0 =A0 =A0 =A0at org.apache.solr.client.solrj.request.UpdateRequest.proc= ess(UpdateRequest.java:268) > =A0 =A0 =A0 =A0at org.apache.solr.client.solrj.SolrServer.commit(SolrServ= er.java:86) > =A0 =A0 =A0 =A0at org.apache.solr.hadoop.SolrRecordWriter$1.run(SolrRecor= dWriter.java:239) > Caused by: org.apache.solr.client.solrj.SolrServerException: > java.lang.RuntimeException: after flush: fdx size mismatch: 468 docs > vs 298404 length in bytes of _0.fdx > =A0 =A0 =A0 =A0at org.apache.solr.client.solrj.embedded.EmbeddedSolrServe= r.request(EmbeddedSolrServer.java:141) > =A0 =A0 =A0 =A0... 3 more > Caused by: java.lang.RuntimeException: after flush: fdx size mismatch: > 468 docs vs 298404 length in bytes of _0.fdx > =A0 =A0 =A0 =A0at org.apache.lucene.index.StoredFieldsWriter.closeDocStor= e(StoredFieldsWriter.java:95) > =A0 =A0 =A0 =A0at org.apache.lucene.index.DocFieldProcessor.closeDocStore= (DocFieldProcessor.java:50) > =A0 =A0 =A0 =A0at org.apache.lucene.index.DocumentsWriter.closeDocStore(D= ocumentsWriter.java:380) > =A0 =A0 =A0 =A0at org.apache.lucene.index.DocumentsWriter.flush(Documents= Writer.java:574) > =A0 =A0 =A0 =A0at org.apache.lucene.index.IndexWriter.doFlushInternal(Ind= exWriter.java:4212) > =A0 =A0 =A0 =A0at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter= .java:4110) > =A0 =A0 =A0 =A0at org.apache.lucene.index.IndexWriter.flush(IndexWriter.j= ava:4101) > =A0 =A0 =A0 =A0at org.apache.lucene.index.IndexWriter.closeInternal(Index= Writer.java:2108) > =A0 =A0 =A0 =A0at org.apache.lucene.index.IndexWriter.close(IndexWriter.j= ava:2071) > =A0 =A0 =A0 =A0at org.apache.lucene.index.IndexWriter.close(IndexWriter.j= ava:2035) > =A0 =A0 =A0 =A0at org.apache.solr.update.SolrIndexWriter.close(SolrIndexW= riter.java:215) > =A0 =A0 =A0 =A0at org.apache.solr.update.DirectUpdateHandler2.closeWriter= (DirectUpdateHandler2.java:180) > =A0 =A0 =A0 =A0at org.apache.solr.update.DirectUpdateHandler2.commit(Dire= ctUpdateHandler2.java:404) > =A0 =A0 =A0 =A0at org.apache.solr.update.processor.RunUpdateProcessor.pro= cessCommit(RunUpdateProcessorFactory.java:85) > =A0 =A0 =A0 =A0at org.apache.solr.handler.RequestHandlerUtils.handleCommi= t(RequestHandlerUtils.java:105) > =A0 =A0 =A0 =A0at org.apache.solr.handler.ContentStreamHandlerBase.handle= RequestBody(ContentStreamHandlerBase.java:48) > =A0 =A0 =A0 =A0at org.apache.solr.handler.RequestHandlerBase.handleReques= t(RequestHandlerBase.java:131) > =A0 =A0 =A0 =A0at org.apache.solr.core.SolrCore.execute(SolrCore.java:129= 9) > =A0 =A0 =A0 =A0at org.apache.solr.client.solrj.embedded.EmbeddedSolrServe= r.request(EmbeddedSolrServer.java:139) > =A0 =A0 =A0 =A0... 3 more > > --------------------------------------------------------------------- > To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org > For additional commands, e-mail: java-user-help@lucene.apache.org > > --------------------------------------------------------------------- To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org For additional commands, e-mail: java-user-help@lucene.apache.org