Return-Path: Delivered-To: apmail-jakarta-lucene-user-archive@www.apache.org Received: (qmail 37480 invoked from network); 11 Nov 2004 05:36:26 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (209.237.227.199) by minotaur-2.apache.org with SMTP; 11 Nov 2004 05:36:26 -0000 Received: (qmail 36163 invoked by uid 500); 11 Nov 2004 05:36:22 -0000 Delivered-To: apmail-jakarta-lucene-user-archive@jakarta.apache.org Received: (qmail 36146 invoked by uid 500); 11 Nov 2004 05:36:22 -0000 Mailing-List: contact lucene-user-help@jakarta.apache.org; run by ezmlm Precedence: bulk List-Unsubscribe: List-Subscribe: List-Help: List-Post: List-Id: "Lucene Users List" Reply-To: "Lucene Users List" Delivered-To: mailing list lucene-user@jakarta.apache.org Received: (qmail 36131 invoked by uid 99); 11 Nov 2004 05:36:22 -0000 Received-SPF: pass (hermes.apache.org: local policy) Received: from [216.136.173.244] (HELO web12707.mail.yahoo.com) (216.136.173.244) by apache.org (qpsmtpd/0.28) with SMTP; Wed, 10 Nov 2004 21:36:22 -0800 Received: (qmail 79865 invoked by uid 60001); 11 Nov 2004 05:36:16 -0000 Comment: DomainKeys? See http://antispam.yahoo.com/domainkeys DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; b=6P3LGN1BM7asZovU6cwftnRF534Jw+ocEpd/1VK97s75ngRX29dqGTr7f7UlKtENDsFTIlsC/cYz/g5yzX3dSq4FjLyK7327lBo0UdgKpjZmsfRyM5RbHtMTpxTjbpSWF7ffa0vmJ1gC7Yw3gHl3TS4aMk96m8RPSi2Z4jW6HHY= ; Message-ID: <20041111053616.79863.qmail@web12707.mail.yahoo.com> Received: from [69.112.2.199] by web12707.mail.yahoo.com via HTTP; Wed, 10 Nov 2004 21:36:16 PST Date: Wed, 10 Nov 2004 21:36:16 -0800 (PST) From: Otis Gospodnetic Subject: Re: Search scalability To: Lucene Users List In-Reply-To: <4568BE33B520DD43B7B24DE0B609B215440263@htexc.hq.htinc.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Virus-Checked: Checked X-Spam-Rating: minotaur-2.apache.org 1.6.2 0/1000/N Hello, 100 parallel searches going against a single index on a single disk means a lot of disk seeks all happening at once. One simple way of working around this is to load your FSDirectory into RAMDirectory. This should be faster (could you report your observations/comparisons?). You can also try using ramfs if you are using Linux. Otis --- Ravi wrote: > We have one large index for a document repository of 800,000 > documents. > The size of the index is 800MB. When we do searches against the > index, > it takes 300-500ms for a single search. We wanted to test the > scalability and tried 100 parallel searches against the index with > the > same query and the average response time was 13 seconds. We used a > simple IndexSearcher. Same searcher object was shared by all the > searches. I'm sure people have success in configuring lucene for > better > scalability. Can somebody share their approach? > > Thanks > Ravi. > > --------------------------------------------------------------------- > To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org > For additional commands, e-mail: lucene-user-help@jakarta.apache.org > > --------------------------------------------------------------------- To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org For additional commands, e-mail: lucene-user-help@jakarta.apache.org