lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Michael McCandless <luc...@mikemccandless.com>
Subject Re: lucene indexwriter crash
Date Thu, 25 Jul 2013 14:47:32 GMT
Something must have gone wrong on the remote mount's end, or in the
network communications b/w the client and the server?  It could really
be anything...

In general it's riskier and often far lower performance to host the
index on a remote mount.

It's better to replicate the index locally; the new replication module
makes this easier.

Mike McCandless

http://blog.mikemccandless.com


On Thu, Jul 25, 2013 at 10:45 AM, ash nix <nixdash@gmail.com> wrote:
> Hi Mike,
>
> Thanks for your help.
> This is remote mount.
> Do you know possible reasons of why it can crash on remote mounts.
>
> Thank,
> Ashwin
>
>
> On Thu, Jul 25, 2013 at 4:29 AM, Michael McCandless <
> lucene@mikemccandless.com> wrote:
>
>> It looks like something is wrong with your IO system?  Is this a local
>> drive or a remote mount?
>>
>> IndexWriter tried to create a new file and hit that odd Input/output
>> error...
>>
>> Mike McCandless
>>
>> http://blog.mikemccandless.com
>>
>>
>> On Wed, Jul 24, 2013 at 8:53 PM, ash nix <nixdash@gmail.com> wrote:
>> > Hi,
>> >
>> > I am using lucene 4 to index very big data.
>> > The indexer crashed after three days (147Gig of current index size). I
>> find
>> > the stack trash weird.
>> > Any ideas on this will be helpful.
>> >
>> > Exception in thread "main" java.io.FileNotFoundException:
>> >
>> /ir/data/data/collections/KBA/2013/index/1322092800-1326499200/_9cx_Lucene40_0.tim
>> > (Input/output error)
>> >         at java.io.RandomAccessFile.open(Native Method)
>> >         at java.io.RandomAccessFile.<init>(RandomAccessFile.java:233)
>> >         at
>> >
>> org.apache.lucene.store.FSDirectory$FSIndexOutput.<init>(FSDirectory.java:512)
>> >         at
>> > org.apache.lucene.store.FSDirectory.createOutput(FSDirectory.java:289)
>> >         at
>> >
>> org.apache.lucene.store.TrackingDirectoryWrapper.createOutput(TrackingDirectoryWrapper.java:62)
>> >         at
>> >
>> org.apache.lucene.codecs.BlockTreeTermsWriter.<init>(BlockTreeTermsWriter.java:160)
>> >         at
>> >
>> org.apache.lucene.codecs.lucene40.Lucene40PostingsFormat.fieldsConsumer(Lucene40PostingsFormat.java:304)
>> >         at
>> >
>> org.apache.lucene.codecs.perfield.PerFieldPostingsFormat$FieldsWriter.addField(PerFieldPostingsFormat.java:130)
>> >         at
>> >
>> org.apache.lucene.index.FreqProxTermsWriterPerField.flush(FreqProxTermsWriterPerField.java:335)
>> >         at
>> >
>> org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:85)
>> >         at org.apache.lucene.index.TermsHash.flush(TermsHash.java:117)
>> >         at org.apache.lucene.index.DocInverter.flush(DocInverter.java:53)
>> >         at
>> >
>> org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:82)
>> >         at
>> >
>> org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:482)
>> >         at
>> > org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:419)
>> >         at
>> >
>> org.apache.lucene.index.DocumentsWriter.postUpdate(DocumentsWriter.java:313)
>> >         at
>> >
>> org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:386)
>> >         at
>> > org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1445)
>> >         at
>> > org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1124)
>> >         at
>> > org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1105)
>> >         at
>> kba.NewCorpusReader.createLuceneIndex(NewCorpusReader.java:747)
>> >         at kba.NewCorpusReader.main(NewCorpusReader.java:825)
>> >
>> > --
>> > Thanks,
>> > A
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>
>>
>
>
> --
> Thanks,
> A

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


Mime
View raw message