From java-user-return-49288-apmail-lucene-java-user-archive=lucene.apache.org@lucene.apache.org Mon Apr 04 19:06:25 2011 Return-Path: Delivered-To: apmail-lucene-java-user-archive@www.apache.org Received: (qmail 9395 invoked from network); 4 Apr 2011 19:06:24 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 4 Apr 2011 19:06:24 -0000 Received: (qmail 89984 invoked by uid 500); 4 Apr 2011 19:06:22 -0000 Delivered-To: apmail-lucene-java-user-archive@lucene.apache.org Received: (qmail 89949 invoked by uid 500); 4 Apr 2011 19:06:22 -0000 Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: java-user@lucene.apache.org Delivered-To: mailing list java-user@lucene.apache.org Received: (qmail 89941 invoked by uid 99); 4 Apr 2011 19:06:22 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 04 Apr 2011 19:06:22 +0000 X-ASF-Spam-Status: No, hits=2.5 required=5.0 tests=FREEMAIL_ENVFROM_END_DIGIT,FREEMAIL_FROM,FREEMAIL_REPLYTO_END_DIGIT,RCVD_IN_DNSWL_LOW,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of paul_t100@fastmail.fm designates 66.111.4.27 as permitted sender) Received: from [66.111.4.27] (HELO out3.smtp.messagingengine.com) (66.111.4.27) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 04 Apr 2011 19:06:15 +0000 Received: from compute3.internal (compute3.nyi.mail.srv.osa [10.202.2.43]) by gateway1.messagingengine.com (Postfix) with ESMTP id D352120D81 for ; Mon, 4 Apr 2011 15:05:54 -0400 (EDT) Received: from frontend2.messagingengine.com ([10.202.2.161]) by compute3.internal (MEProxy); Mon, 04 Apr 2011 15:05:54 -0400 DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; d=messagingengine.com; h=message-id:date:from:reply-to:mime-version:to:subject:content-type:content-transfer-encoding; s=smtpout; bh=pxSHkcgbhAd7/aeRz3GjW+c6kz0=; b=NqScyghQmVGcOiZFFIc1bkNT9IxXTW8Dp2lyJlcIA2p/6iS/6fpLKT4fWJDwcAQYPNZS64TujMdwLt2hN9Ax+bYZ+lFkeIvQuY4FcqsfnJLRoJ+8u/W3gB/Ukk77RsSO3lPAd8fh/G6RdHQ0n6AwMxm+nxIaBS6O5ITLrgQh6yQ= X-Sasl-enc: Z2L8XojkItFrQju3j8r6OyuCz0EHb7Q74XKXi3C4mCEr 1301943954 Received: from [192.168.1.65] (unknown [217.155.98.246]) by mail.messagingengine.com (Postfix) with ESMTPSA id F116244527B for ; Mon, 4 Apr 2011 15:05:53 -0400 (EDT) Message-ID: <4D9A168B.5020208@fastmail.fm> Date: Mon, 04 Apr 2011 20:05:47 +0100 From: Paul Taylor Reply-To: paul_t100@fastmail.fm User-Agent: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2.15) Gecko/20110303 Thunderbird/3.1.9 MIME-Version: 1.0 To: java-user@lucene.apache.org Subject: Lucene Merge failing on Open Files Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Problem trying to merge indexes in the background whilst building some others, works okay on my humble labtop but fails on another machine, although it seems to allow 700,000 file handles Exception in thread "Lucene Merge Thread #0" org.apache.lucene.index.MergePolicy$MergeException: java.io.FileNotFoundException: /home/musicbrainz/search_server/data/recording_index/_rs.cfs (Too many open files) at org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException(ConcurrentMergeScheduler.java:347) at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:312) Caused by: java.io.FileNotFoundException: /home/robert/musicbrainz/search_server/data/recording_index/_rs.cfs (Too many open files) at java.io.RandomAccessFile.open(Native Method) at java.io.RandomAccessFile.(RandomAccessFile.java:233) at org.apache.lucene.store.SimpleFSDirectory$SimpleFSIndexInput$Descriptor.(SimpleFSDirectory.java:76) at org.apache.lucene.store.SimpleFSDirectory$SimpleFSIndexInput.(SimpleFSDirectory.java:97) at org.apache.lucene.store.NIOFSDirectory$NIOFSIndexInput.(NIOFSDirectory.java:98) at org.apache.lucene.store.NIOFSDirectory.openInput(NIOFSDirectory.java:78) at org.apache.lucene.index.CompoundFileReader.(CompoundFileReader.java:67) at org.apache.lucene.index.SegmentReader$CoreReaders.(SegmentReader.java:115) at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:605) at org.apache.lucene.index.IndexWriter$ReaderPool.get(IndexWriter.java:622) at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4394) at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:4000) at org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:231) at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:288) Anyone got some ideas on how I can get to the bottom of this, Im using lucene 3.03 thank Paul --------------------------------------------------------------------- To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org For additional commands, e-mail: java-user-help@lucene.apache.org