Return-Path: Delivered-To: apmail-lucene-java-user-archive@www.apache.org Received: (qmail 19326 invoked from network); 17 Oct 2008 08:10:26 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 17 Oct 2008 08:10:26 -0000 Received: (qmail 45199 invoked by uid 500); 17 Oct 2008 08:10:20 -0000 Delivered-To: apmail-lucene-java-user-archive@lucene.apache.org Received: (qmail 45165 invoked by uid 500); 17 Oct 2008 08:10:20 -0000 Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: java-user@lucene.apache.org Delivered-To: mailing list java-user@lucene.apache.org Received: (qmail 45154 invoked by uid 99); 17 Oct 2008 08:10:20 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 17 Oct 2008 01:10:20 -0700 X-ASF-Spam-Status: No, hits=2.0 required=10.0 tests=HTML_MESSAGE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of yarimahdi@gmail.com designates 209.85.128.186 as permitted sender) Received: from [209.85.128.186] (HELO fk-out-0910.google.com) (209.85.128.186) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 17 Oct 2008 08:09:09 +0000 Received: by fk-out-0910.google.com with SMTP id 18so412245fkq.5 for ; Fri, 17 Oct 2008 01:09:36 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:in-reply-to:mime-version:content-type:references; bh=/GDfAIp4VHLYH+XfmygpQR+S30NQASH0g9bxLamzfTA=; b=L9sCKrX1au0YVmeOF2qcrZ3s/VIh/5g5AmW0x6PH550bUx3J9JWrM4fxVND7B80fXO pJeNtCNH3sTJlnBD2j2yVmguDC65aubAtWk6wdXojaiPsAyCOnqX/BLKebcOxCOBIK0z 6NNqZUaGL/o6XawTY8b2KmIF2qwKeP9Y5O7qU= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:in-reply-to:mime-version :content-type:references; b=VObbXL+E3QNYtMcXiuUbeABTVML8SkDHobXggq5bXluW4C/iUTfs7YyBeGKxAWiSld rhDqrx4HTyKhsKHfnWOz89Cms+J/XPRb+fi3KR1wulNS2vdoDhDA3yNeq6s9MGZ1Iitz /DQ6/DiCKmafYCi00DyBGIwprPNqYPPSILZ5g= Received: by 10.187.221.13 with SMTP id y13mr502794faq.1.1224230976109; Fri, 17 Oct 2008 01:09:36 -0700 (PDT) Received: by 10.187.250.20 with HTTP; Fri, 17 Oct 2008 01:09:36 -0700 (PDT) Message-ID: Date: Fri, 17 Oct 2008 11:39:36 +0330 From: "mahdi yari" To: java-user@lucene.apache.org Subject: Re: How to restore corrupted index In-Reply-To: <5B3E2464-285A-41A0-A1D5-73343E133B7F@mikemccandless.com> MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_Part_86387_22709108.1224230976114" References: <0B7F1A83-825C-406B-AAE6-23028E777DC0@mikemccandless.com> <0CD49D04A7B5534CA56257ADD9719EF703751240@indiaserv01.asite.asitehq.com> <5B3E2464-285A-41A0-A1D5-73343E133B7F@mikemccandless.com> X-Virus-Checked: Checked by ClamAV on apache.org ------=_Part_86387_22709108.1224230976114 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline just one IndexWriter writes on Index and after a specific time(like one day or one week etc), i create a new IndexWriter on new Directory and another thread try to optimize old IndexWirter. On Thu, Oct 16, 2008 at 5:25 PM, Michael McCandless < lucene@mikemccandless.com> wrote: > > Can you post the full traceback for your exception, and describe your > indexing process as well? > > Mike > > > mahdi yari wrote: > > hi dears >> i have same problem >> i indexing on Ubuntu Linux Distro and i have large index (>30G) and >> mergeFactor = 10, >> my Lucene version is 2.2.0 >> i think this maybe bug on Lucene 2.2.0 >> >> but i get this error sometimes, not always >> thanks alot >> >> >> On Thu, Oct 16, 2008 at 3:01 PM, Chaula Ganatra >> wrote: >> >> Hi, >>> >>> I am again getting the following error while optimization. >>> >>> >>> java.io.FileNotFoundException: \\machine01\indexes\_w5.cfs (The system >>> cannot find the file specified) >>> 16:20:57,533 INFO [STDOUT] : 140 at >>> java.io.RandomAccessFile.open(Native Method) >>> 16:20:57,533 INFO [STDOUT] : 140 at >>> java.io.RandomAccessFile.(Unknown Source) >>> 16:20:57,533 INFO [STDOUT] : 140 at >>> org.apache.lucene.store.FSDirectory$FSIndexInput$Descriptor.(FSDir >>> ectory.java:506) >>> 16:20:57,533 INFO [STDOUT] : 140 at >>> org.apache.lucene.store.FSDirectory$FSIndexInput.(FSDirectory.java >>> :536) >>> 16:20:57,565 INFO [STDOUT] : 140 at >>> org.apache.lucene.store.FSDirectory.openInput(FSDirectory.java:445) >>> 16:20:57,565 INFO [STDOUT] : 140 at >>> org.apache.lucene.index.CompoundFileReader.(CompoundFileReader.jav >>> a:70) >>> 16:20:57,565 INFO [STDOUT] : 140 at >>> org.apache.lucene.index.SegmentReader.initialize(SegmentReader.java:181) >>> 16:20:57,565 INFO [STDOUT] : 140 at >>> org.apache.lucene.index.SegmentReader.get(SegmentReader.java:167) >>> 16:20:57,565 INFO [STDOUT] : 140 at >>> org.apache.lucene.index.SegmentReader.get(SegmentReader.java:139) >>> 16:20:57,565 INFO [STDOUT] : 140 at >>> org.apache.lucene.index.IndexWriter.mergeSegments(IndexWriter.java:1867) >>> 16:20:57,565 INFO [STDOUT] : 140 at >>> org.apache.lucene.index.IndexWriter.optimize(IndexWriter.java:1231) >>> >>> >>> If I try to optimize it again then also getting the same error. >>> >>> Can anyone please help me out? It is occurring on live environment. >>> >>> >>> Regards, >>> Chaula >>> >>> -----Original Message----- >>> From: Michael McCandless [mailto:lucene@mikemccandless.com] >>> Sent: 26 September, 2008 8:00 PM >>> To: java-user@lucene.apache.org >>> Subject: Re: How to restore corrupted index >>> >>> >>> It's perfectly fine to have a reader open on an index, while an >>> IndexWriter runs optimize. >>> >>> Which version of Lucene are you using? And which OS & filesystem? >>> >>> Mike >>> >>> Chaula Ganatra wrote: >>> >>> It was the Reader on same index, which I did not close so gave >>>> exception >>>> in writer.optimise() >>>> >>>> Chaula >>>> >>>> -----Original Message----- >>>> From: Michael McCandless [mailto:lucene@mikemccandless.com] >>>> Sent: 26 September, 2008 7:17 PM >>>> To: java-user@lucene.apache.org >>>> Subject: Re: How to restore corrupted index >>>> >>>> >>>> Can you post the full stack trace in both cases? >>>> >>>> Mike >>>> >>>> Chaula Ganatra wrote: >>>> >>>> I found one case when such multiple files are remained, when we call >>>>> writer.optimise() it throws exception and multiple files remained in >>>>> index dir. >>>>> >>>>> After such multiple files, when we add document in index by calling >>>>> writer.addDocument it throws java.lang.NegativeArraySizeException >>>>> >>>>> Regards, >>>>> Chaula >>>>> >>>>> -----Original Message----- >>>>> From: Grant Ingersoll [mailto:gsingers@apache.org] >>>>> Sent: 26 September, 2008 6:02 PM >>>>> To: java-user@lucene.apache.org >>>>> Subject: Re: How to restore corrupted index >>>>> >>>>> There is the CheckIndex tool included in the distribution for >>>>> checking/ >>>>> fixing bad indexes, but it can't solve everything. >>>>> >>>>> The bigger question is why it is happening to begin with. Can you >>>>> describe your indexing process? How do you know the index is >>>>> actually >>>>> corrupted? Are you seeing exceptions when opening it? >>>>> >>>>> -Grant >>>>> On Sep 26, 2008, at 6:49 AM, Chaula Ganatra wrote: >>>>> >>>>> We have an application in which index will be updated frequently. >>>>>> >>>>>> During development time, found that index files gets corrupted, i.e. >>>>>> more than one cfs files,some other extension files e.g. frq, fnm, >>>>>> nrm >>>>>> >>>>>> Remains there in index directory. >>>>>> >>>>>> Is there any way that such issue does not occur at all or if it >>>>>> happens >>>>>> we can recover the index data again? >>>>>> >>>>>> It would be a great help, if some one can. >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> Regards, >>>>>> >>>>>> Chaula >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>> -------------------------- >>>>> Grant Ingersoll >>>>> http://www.lucidimagination.com >>>>> >>>>> Lucene Helpful Hints: >>>>> http://wiki.apache.org/lucene-java/BasicsOfPerformance >>>>> http://wiki.apache.org/lucene-java/LuceneFAQ >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> --------------------------------------------------------------------- >>>>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org >>>>> For additional commands, e-mail: java-user-help@lucene.apache.org >>>>> >>>>> >>>>> --------------------------------------------------------------------- >>>>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org >>>>> For additional commands, e-mail: java-user-help@lucene.apache.org >>>>> >>>>> >>>> >>>> --------------------------------------------------------------------- >>>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org >>>> For additional commands, e-mail: java-user-help@lucene.apache.org >>>> >>>> >>>> --------------------------------------------------------------------- >>>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org >>>> For additional commands, e-mail: java-user-help@lucene.apache.org >>>> >>>> >>> >>> --------------------------------------------------------------------- >>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org >>> For additional commands, e-mail: java-user-help@lucene.apache.org >>> >>> >>> --------------------------------------------------------------------- >>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org >>> For additional commands, e-mail: java-user-help@lucene.apache.org >>> >>> >>> > > --------------------------------------------------------------------- > To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org > For additional commands, e-mail: java-user-help@lucene.apache.org > > ------=_Part_86387_22709108.1224230976114--