Return-Path: Delivered-To: apmail-lucene-java-user-archive@www.apache.org Received: (qmail 43010 invoked from network); 2 Apr 2005 09:38:07 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (209.237.227.199) by minotaur.apache.org with SMTP; 2 Apr 2005 09:38:07 -0000 Received: (qmail 43530 invoked by uid 500); 2 Apr 2005 09:38:04 -0000 Delivered-To: apmail-lucene-java-user-archive@lucene.apache.org Received: (qmail 43507 invoked by uid 500); 2 Apr 2005 09:38:04 -0000 Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: java-user@lucene.apache.org Delivered-To: mailing list java-user@lucene.apache.org Received: (qmail 43491 invoked by uid 99); 2 Apr 2005 09:38:04 -0000 X-ASF-Spam-Status: No, hits=0.4 required=10.0 tests=DNS_FROM_RFC_ABUSE,RCVD_BY_IP,SPF_HELO_PASS,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (hermes.apache.org: domain of clamprecht@gmail.com designates 64.233.170.202 as permitted sender) Received: from rproxy.gmail.com (HELO rproxy.gmail.com) (64.233.170.202) by apache.org (qpsmtpd/0.28) with ESMTP; Sat, 02 Apr 2005 01:38:02 -0800 Received: by rproxy.gmail.com with SMTP id y7so880824rne for ; Sat, 02 Apr 2005 01:38:00 -0800 (PST) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:reply-to:to:subject:in-reply-to:mime-version:content-type:content-transfer-encoding:references; b=FFAPFlYkCWxw00eELiy4b0yNuM13/PAN10gXMcg1x+JAiIr9JmzdtX1E1QLr77HBcuEDpuuDBD/o4L+kldY4TRW3HaUxuBTiB28bYiOGwCwMI+MB16U9T5zN0sz7zth1af/cZ6OzCX3pUWa1TyHvwnCrwC8HbDh6otveIx/5mKs= Received: by 10.38.104.35 with SMTP id b35mr3309232rnc; Sat, 02 Apr 2005 01:38:00 -0800 (PST) Received: by 10.38.104.11 with HTTP; Sat, 2 Apr 2005 01:38:00 -0800 (PST) Message-ID: <88c6a6720504020138393ca64b@mail.gmail.com> Date: Sat, 2 Apr 2005 03:38:00 -0600 From: Chris Lamprecht Reply-To: Chris Lamprecht To: java-user@lucene.apache.org Subject: Re: Lucene on Linux problem... In-Reply-To: <20050402082934.6853927E19A@ns2.pil.dk> Mime-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit References: <20050402082934.6853927E19A@ns2.pil.dk> X-Virus-Checked: Checked X-Spam-Rating: minotaur.apache.org 1.6.2 0/1000/N I've also been getting this error very rarely on a production system with lots of search queries. The system is Fedora 1 using ext3. It happens in the call to IndexReader.getCurrentVersion(indexPath). I think it happens when the separate indexing process is running or has just run (from a separate JVM). Here is the stack trace: Caused by: java.io.FileNotFoundException: /lucene/segments (No such file or directory) at java.io.RandomAccessFile.open(Native Method) at java.io.RandomAccessFile.(RandomAccessFile.java:212) at org.apache.lucene.store.FSInputStream$Descriptor.(FSDirectory.java:376) at org.apache.lucene.store.FSInputStream.(FSDirectory.java:405) at org.apache.lucene.store.FSDirectory.openFile(FSDirectory.java:268) at org.apache.lucene.index.SegmentInfos.readCurrentVersion(SegmentInfos.java:106) at org.apache.lucene.index.IndexReader.getCurrentVersion(IndexReader.java:214) at org.apache.lucene.index.IndexReader.getCurrentVersion(IndexReader.java:200) at org.apache.lucene.index.IndexReader.getCurrentVersion(IndexReader.java:187) [...] On Apr 2, 2005 2:29 AM, Kristian Ottosen wrote: > Hello, > > I have really been pulling out hair for a while over this. The problem only > occur using FSDirectory on some Linux system (some Debian, Suse and Redhat - > but not all) and never under Windows, Solaris or Mac OS X. > > What happens is that Lucene for some reason tries to read a segment which > was just merged into another segment and therefore deleted and fails with a > FileNotFoundException. > > A few facts: Only a single thread is involved. If we use a RAM based Store > (RAMDirectory) there is no problem at all. Also there seems to a problem > related to locking using the lock files. We get timeouts even though there > is only a single thread working on the index. Switching the compound file > format on/off makes no difference. The problem may not appear immediately - > but only after several thousand documents have been indexed in a row using a > combination of IndexSearcher (check for duplicates) and IndexWriter (add > document) operations. > > I wonder if there is general problem running Lucene on top of some of the > journaling file systems like ReiserFS or Ext3? > > Any help or hints are greatly appreciated. Lucene is an excellent piece of > software. > > Best Regards > Kristian > > --------------------------------------------------------------------- > To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org > For additional commands, e-mail: java-user-help@lucene.apache.org > > --------------------------------------------------------------------- To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org For additional commands, e-mail: java-user-help@lucene.apache.org