Return-Path: Delivered-To: apmail-jakarta-lucene-user-archive@www.apache.org Received: (qmail 89453 invoked from network); 1 Dec 2003 22:40:47 -0000 Received: from daedalus.apache.org (HELO mail.apache.org) (208.185.179.12) by minotaur-2.apache.org with SMTP; 1 Dec 2003 22:40:47 -0000 Received: (qmail 16549 invoked by uid 500); 1 Dec 2003 22:40:30 -0000 Delivered-To: apmail-jakarta-lucene-user-archive@jakarta.apache.org Received: (qmail 16519 invoked by uid 500); 1 Dec 2003 22:40:29 -0000 Mailing-List: contact lucene-user-help@jakarta.apache.org; run by ezmlm Precedence: bulk List-Unsubscribe: List-Subscribe: List-Help: List-Post: List-Id: "Lucene Users List" Reply-To: "Lucene Users List" Delivered-To: mailing list lucene-user@jakarta.apache.org Received: (qmail 16506 invoked from network); 1 Dec 2003 22:40:29 -0000 Received: from unknown (HELO localhost.localdomain) (12.43.53.195) by daedalus.apache.org with SMTP; 1 Dec 2003 22:40:29 -0000 Received: from newsmonster.org (localhost [127.0.0.1]) by localhost.localdomain (8.12.8/8.12.8) with ESMTP id hB1MeaLr006611 for ; Mon, 1 Dec 2003 14:40:36 -0800 Message-ID: <3FCBC364.2080100@newsmonster.org> Date: Mon, 01 Dec 2003 14:40:36 -0800 From: "Kevin A. Burton" User-Agent: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.4) Gecko/20030624 X-Accept-Language: en MIME-Version: 1.0 To: Lucene Users List Subject: Re: disable locks on read only indexes (performance improvement?) References: <3FCBB4E8.7080309@newsmonster.org> <20031201215823.GR30893@rlx11.zapatec.com> In-Reply-To: <20031201215823.GR30893@rlx11.zapatec.com> X-Enigmail-Version: 0.76.1.0 X-Enigmail-Supports: pgp-inline, pgp-mime Content-Type: multipart/alternative; boundary="------------030307020606010305030508" X-Spam-Rating: daedalus.apache.org 1.6.2 0/1000/N X-Spam-Rating: minotaur-2.apache.org 1.6.2 0/1000/N --------------030307020606010305030508 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit Dror Matalon wrote: >>I would assume that removing this lock could increase performance >>especially to allow multiple concurrent searches on the same data. >> >> > >There was talk about providing that in an upcoming version. Until then >you can try RODirectory: > http://www.csita.unige.it/software/free/lucene/ > > Looking at the source of FSDirectory it seem easy enough to add a property to disable indexes. This way if you wanted to search a directory and you new it was 100% necessary to search it readonly you could go ahead and do it without having to write lock files. I will write some unit tests to see what the performance is here. It should be trivial to create an index of a few hundred megs and then run about 200k queries across it with 30 threads or so... then disable locks and see what the total time spent was... If it's substantial I think it makes sense to make this contribution :) Kevin -- NewsMonster - http://www.newsmonster.org/ Kevin A. Burton, Location - San Francisco, CA, Cell - 415.595.9965 AIM - sfburtonator, Web - http://www.peerfear.org/ GPG fingerprint: 4D20 40A0 C734 307E C7B4 DCAA 0303 3AC5 BD9D 7C4D IRC - freenode.net #infoanarchy | #p2p-hackers | #newsmonster --------------030307020606010305030508--