Return-Path: Delivered-To: apmail-lucene-java-user-archive@www.apache.org Received: (qmail 1819 invoked from network); 16 Oct 2008 13:55:42 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 16 Oct 2008 13:55:42 -0000 Received: (qmail 69623 invoked by uid 500); 16 Oct 2008 13:55:36 -0000 Delivered-To: apmail-lucene-java-user-archive@lucene.apache.org Received: (qmail 69577 invoked by uid 500); 16 Oct 2008 13:55:36 -0000 Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: java-user@lucene.apache.org Delivered-To: mailing list java-user@lucene.apache.org Received: (qmail 69566 invoked by uid 99); 16 Oct 2008 13:55:36 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 16 Oct 2008 06:55:36 -0700 X-ASF-Spam-Status: No, hits=1.2 required=10.0 tests=SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (athena.apache.org: local policy) Received: from [209.85.132.242] (HELO an-out-0708.google.com) (209.85.132.242) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 16 Oct 2008 13:54:26 +0000 Received: by an-out-0708.google.com with SMTP id c37so464anc.49 for ; Thu, 16 Oct 2008 06:55:03 -0700 (PDT) Received: by 10.100.93.17 with SMTP id q17mr3468810anb.104.1224165302811; Thu, 16 Oct 2008 06:55:02 -0700 (PDT) Received: from ?10.17.4.4? (pool-96-237-252-30.bstnma.fios.verizon.net [96.237.252.30]) by mx.google.com with ESMTPS id b3sm2359192ana.7.2008.10.16.06.55.01 (version=TLSv1/SSLv3 cipher=RC4-MD5); Thu, 16 Oct 2008 06:55:01 -0700 (PDT) Message-Id: <5B3E2464-285A-41A0-A1D5-73343E133B7F@mikemccandless.com> From: Michael McCandless To: java-user@lucene.apache.org In-Reply-To: Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v929.2) Subject: Re: How to restore corrupted index Date: Thu, 16 Oct 2008 09:55:01 -0400 References: <0B7F1A83-825C-406B-AAE6-23028E777DC0@mikemccandless.com> <0CD49D04A7B5534CA56257ADD9719EF703751240@indiaserv01.asite.asitehq.com> X-Mailer: Apple Mail (2.929.2) X-Virus-Checked: Checked by ClamAV on apache.org Can you post the full traceback for your exception, and describe your indexing process as well? Mike mahdi yari wrote: > hi dears > i have same problem > i indexing on Ubuntu Linux Distro and i have large index (>30G) and > mergeFactor = 10, > my Lucene version is 2.2.0 > i think this maybe bug on Lucene 2.2.0 > > but i get this error sometimes, not always > thanks alot > > > On Thu, Oct 16, 2008 at 3:01 PM, Chaula Ganatra > wrote: > >> Hi, >> >> I am again getting the following error while optimization. >> >> >> java.io.FileNotFoundException: \\machine01\indexes\_w5.cfs (The >> system >> cannot find the file specified) >> 16:20:57,533 INFO [STDOUT] : 140 at >> java.io.RandomAccessFile.open(Native Method) >> 16:20:57,533 INFO [STDOUT] : 140 at >> java.io.RandomAccessFile.(Unknown Source) >> 16:20:57,533 INFO [STDOUT] : 140 at >> org.apache.lucene.store.FSDirectory$FSIndexInput >> $Descriptor.(FSDir >> ectory.java:506) >> 16:20:57,533 INFO [STDOUT] : 140 at >> org.apache.lucene.store.FSDirectory >> $FSIndexInput.(FSDirectory.java >> :536) >> 16:20:57,565 INFO [STDOUT] : 140 at >> org.apache.lucene.store.FSDirectory.openInput(FSDirectory.java:445) >> 16:20:57,565 INFO [STDOUT] : 140 at >> org >> .apache.lucene.index.CompoundFileReader.(CompoundFileReader.jav >> a:70) >> 16:20:57,565 INFO [STDOUT] : 140 at >> org.apache.lucene.index.SegmentReader.initialize(SegmentReader.java: >> 181) >> 16:20:57,565 INFO [STDOUT] : 140 at >> org.apache.lucene.index.SegmentReader.get(SegmentReader.java:167) >> 16:20:57,565 INFO [STDOUT] : 140 at >> org.apache.lucene.index.SegmentReader.get(SegmentReader.java:139) >> 16:20:57,565 INFO [STDOUT] : 140 at >> org.apache.lucene.index.IndexWriter.mergeSegments(IndexWriter.java: >> 1867) >> 16:20:57,565 INFO [STDOUT] : 140 at >> org.apache.lucene.index.IndexWriter.optimize(IndexWriter.java:1231) >> >> >> If I try to optimize it again then also getting the same error. >> >> Can anyone please help me out? It is occurring on live environment. >> >> >> Regards, >> Chaula >> >> -----Original Message----- >> From: Michael McCandless [mailto:lucene@mikemccandless.com] >> Sent: 26 September, 2008 8:00 PM >> To: java-user@lucene.apache.org >> Subject: Re: How to restore corrupted index >> >> >> It's perfectly fine to have a reader open on an index, while an >> IndexWriter runs optimize. >> >> Which version of Lucene are you using? And which OS & filesystem? >> >> Mike >> >> Chaula Ganatra wrote: >> >>> It was the Reader on same index, which I did not close so gave >>> exception >>> in writer.optimise() >>> >>> Chaula >>> >>> -----Original Message----- >>> From: Michael McCandless [mailto:lucene@mikemccandless.com] >>> Sent: 26 September, 2008 7:17 PM >>> To: java-user@lucene.apache.org >>> Subject: Re: How to restore corrupted index >>> >>> >>> Can you post the full stack trace in both cases? >>> >>> Mike >>> >>> Chaula Ganatra wrote: >>> >>>> I found one case when such multiple files are remained, when we >>>> call >>>> writer.optimise() it throws exception and multiple files remained >>>> in >>>> index dir. >>>> >>>> After such multiple files, when we add document in index by calling >>>> writer.addDocument it throws java.lang.NegativeArraySizeException >>>> >>>> Regards, >>>> Chaula >>>> >>>> -----Original Message----- >>>> From: Grant Ingersoll [mailto:gsingers@apache.org] >>>> Sent: 26 September, 2008 6:02 PM >>>> To: java-user@lucene.apache.org >>>> Subject: Re: How to restore corrupted index >>>> >>>> There is the CheckIndex tool included in the distribution for >>>> checking/ >>>> fixing bad indexes, but it can't solve everything. >>>> >>>> The bigger question is why it is happening to begin with. Can you >>>> describe your indexing process? How do you know the index is >>>> actually >>>> corrupted? Are you seeing exceptions when opening it? >>>> >>>> -Grant >>>> On Sep 26, 2008, at 6:49 AM, Chaula Ganatra wrote: >>>> >>>>> We have an application in which index will be updated frequently. >>>>> >>>>> During development time, found that index files gets corrupted, >>>>> i.e. >>>>> more than one cfs files,some other extension files e.g. frq, fnm, >>>>> nrm >>>>> >>>>> Remains there in index directory. >>>>> >>>>> Is there any way that such issue does not occur at all or if it >>>>> happens >>>>> we can recover the index data again? >>>>> >>>>> It would be a great help, if some one can. >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> Regards, >>>>> >>>>> Chaula >>>>> >>>>> >>>>> >>>>> >>>>> >>>> >>>> -------------------------- >>>> Grant Ingersoll >>>> http://www.lucidimagination.com >>>> >>>> Lucene Helpful Hints: >>>> http://wiki.apache.org/lucene-java/BasicsOfPerformance >>>> http://wiki.apache.org/lucene-java/LuceneFAQ >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> --------------------------------------------------------------------- >>>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org >>>> For additional commands, e-mail: java-user-help@lucene.apache.org >>>> >>>> >>>> --------------------------------------------------------------------- >>>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org >>>> For additional commands, e-mail: java-user-help@lucene.apache.org >>>> >>> >>> >>> --------------------------------------------------------------------- >>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org >>> For additional commands, e-mail: java-user-help@lucene.apache.org >>> >>> >>> --------------------------------------------------------------------- >>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org >>> For additional commands, e-mail: java-user-help@lucene.apache.org >>> >> >> >> --------------------------------------------------------------------- >> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org >> For additional commands, e-mail: java-user-help@lucene.apache.org >> >> >> --------------------------------------------------------------------- >> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org >> For additional commands, e-mail: java-user-help@lucene.apache.org >> >> --------------------------------------------------------------------- To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org For additional commands, e-mail: java-user-help@lucene.apache.org