Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: java-user@lucene.apache.org
Received-SPF: pass (athena.apache.org: domain of jason.rutherglen@gmail.com
 designates 209.85.221.171 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :content-type:content-transfer-encoding;
        b=vtLgjk+I/i3Hm++mGs/IL0EyXBIeF1fJ1lZUNsVD+pNzcaDfNt3BXn1Oy/UiBdj1Rw
         qScUzXAIEiuHzr1Q35GY9IHVjQkbaOouWox8m/sXYUblPooN8WDMGN7glBqjGiFro1uu
         d2BhE/+guOcZx8JSnJ9kTHtbOMmB8u9Pq/hrk=
MIME-Version: 1.0
In-Reply-To: <9ac0c6aa0909101649t5ca87f77r8c8525db52d38bf1@mail.gmail.com>
References: <85d3c3b60909101619x401c39a1wc4abb551b35a97b1@mail.gmail.com>
	 <9ac0c6aa0909101649t5ca87f77r8c8525db52d38bf1@mail.gmail.com>
Date: Thu, 10 Sep 2009 17:14:23 -0700
Message-ID: <85d3c3b60909101714s5355982agda3dd7f25eddf731@mail.gmail.com>
Subject: Re: Index docstore flush problem
From: Jason Rutherglen <jason.rutherglen@gmail.com>
To: java-user@lucene.apache.org
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

Indexing locking was off, there was a bug higher up clobbering the
index.  Sorry and thanks!

On Thu, Sep 10, 2009 at 4:49 PM, Michael McCandless
<lucene@mikemccandless.com> wrote:
> That's an odd exception. =A0It means IndexWriter thinks 468 docs have
> been written to the stored fields file, which should mean the fdx file
> size is 3748 (=3D 4 + 468*8), yet the file size is far larger than that
> (298404).
>
> How repeatable is it? =A0Can you turn on infoStream, get the exception
> to happen, then post the resulting output?
>
> Mike
>
> On Thu, Sep 10, 2009 at 7:19 PM, Jason Rutherglen
> <jason.rutherglen@gmail.com> wrote:
>> I'm seeing a strange exception when indexing using the latest Solr rev o=
n EC2.
>>
>> org.apache.solr.client.solrj.SolrServerException:
>> org.apache.solr.client.solrj.SolrServerException:
>> java.lang.RuntimeException: after flush: fdx size mismatch: 468 docs
>> vs 298404 length in bytes of _0.fdx
>> =A0 =A0 =A0 =A0at org.apache.solr.client.solrj.embedded.EmbeddedSolrServ=
er.request(EmbeddedSolrServer.java:153)
>> =A0 =A0 =A0 =A0at org.apache.solr.client.solrj.request.UpdateRequest.pro=
cess(UpdateRequest.java:268)
>> =A0 =A0 =A0 =A0at org.apache.solr.client.solrj.SolrServer.commit(SolrSer=
ver.java:86)
>> =A0 =A0 =A0 =A0at org.apache.solr.hadoop.SolrRecordWriter$1.run(SolrReco=
rdWriter.java:239)
>> Caused by: org.apache.solr.client.solrj.SolrServerException:
>> java.lang.RuntimeException: after flush: fdx size mismatch: 468 docs
>> vs 298404 length in bytes of _0.fdx
>> =A0 =A0 =A0 =A0at org.apache.solr.client.solrj.embedded.EmbeddedSolrServ=
er.request(EmbeddedSolrServer.java:141)
>> =A0 =A0 =A0 =A0... 3 more
>> Caused by: java.lang.RuntimeException: after flush: fdx size mismatch:
>> 468 docs vs 298404 length in bytes of _0.fdx
>> =A0 =A0 =A0 =A0at org.apache.lucene.index.StoredFieldsWriter.closeDocSto=
re(StoredFieldsWriter.java:95)
>> =A0 =A0 =A0 =A0at org.apache.lucene.index.DocFieldProcessor.closeDocStor=
e(DocFieldProcessor.java:50)
>> =A0 =A0 =A0 =A0at org.apache.lucene.index.DocumentsWriter.closeDocStore(=
DocumentsWriter.java:380)
>> =A0 =A0 =A0 =A0at org.apache.lucene.index.DocumentsWriter.flush(Document=
sWriter.java:574)
>> =A0 =A0 =A0 =A0at org.apache.lucene.index.IndexWriter.doFlushInternal(In=
dexWriter.java:4212)
>> =A0 =A0 =A0 =A0at org.apache.lucene.index.IndexWriter.doFlush(IndexWrite=
r.java:4110)
>> =A0 =A0 =A0 =A0at org.apache.lucene.index.IndexWriter.flush(IndexWriter.=
java:4101)
>> =A0 =A0 =A0 =A0at org.apache.lucene.index.IndexWriter.closeInternal(Inde=
xWriter.java:2108)
>> =A0 =A0 =A0 =A0at org.apache.lucene.index.IndexWriter.close(IndexWriter.=
java:2071)
>> =A0 =A0 =A0 =A0at org.apache.lucene.index.IndexWriter.close(IndexWriter.=
java:2035)
>> =A0 =A0 =A0 =A0at org.apache.solr.update.SolrIndexWriter.close(SolrIndex=
Writer.java:215)
>> =A0 =A0 =A0 =A0at org.apache.solr.update.DirectUpdateHandler2.closeWrite=
r(DirectUpdateHandler2.java:180)
>> =A0 =A0 =A0 =A0at org.apache.solr.update.DirectUpdateHandler2.commit(Dir=
ectUpdateHandler2.java:404)
>> =A0 =A0 =A0 =A0at org.apache.solr.update.processor.RunUpdateProcessor.pr=
ocessCommit(RunUpdateProcessorFactory.java:85)
>> =A0 =A0 =A0 =A0at org.apache.solr.handler.RequestHandlerUtils.handleComm=
it(RequestHandlerUtils.java:105)
>> =A0 =A0 =A0 =A0at org.apache.solr.handler.ContentStreamHandlerBase.handl=
eRequestBody(ContentStreamHandlerBase.java:48)
>> =A0 =A0 =A0 =A0at org.apache.solr.handler.RequestHandlerBase.handleReque=
st(RequestHandlerBase.java:131)
>> =A0 =A0 =A0 =A0at org.apache.solr.core.SolrCore.execute(SolrCore.java:12=
99)
>> =A0 =A0 =A0 =A0at org.apache.solr.client.solrj.embedded.EmbeddedSolrServ=
er.request(EmbeddedSolrServer.java:139)
>> =A0 =A0 =A0 =A0... 3 more
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>
>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
>

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org