From java-user-return-24011-apmail-lucene-java-user-archive=lucene.apache.org@lucene.apache.org Sat Oct 14 05:20:06 2006 Return-Path: Delivered-To: apmail-lucene-java-user-archive@www.apache.org Received: (qmail 9953 invoked from network); 14 Oct 2006 05:20:05 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (209.237.227.199) by minotaur.apache.org with SMTP; 14 Oct 2006 05:20:05 -0000 Received: (qmail 74512 invoked by uid 500); 14 Oct 2006 05:19:49 -0000 Delivered-To: apmail-lucene-java-user-archive@lucene.apache.org Received: (qmail 74453 invoked by uid 500); 14 Oct 2006 05:19:49 -0000 Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: java-user@lucene.apache.org Delivered-To: mailing list java-user@lucene.apache.org Received: (qmail 74418 invoked by uid 99); 14 Oct 2006 05:19:49 -0000 Received: from asf.osuosl.org (HELO asf.osuosl.org) (140.211.166.49) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 13 Oct 2006 22:19:49 -0700 X-ASF-Spam-Status: No, hits=0.5 required=10.0 tests=DNS_FROM_RFC_ABUSE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (asf.osuosl.org: domain of artvas@gmail.com designates 66.249.92.168 as permitted sender) Received: from [66.249.92.168] (HELO ug-out-1314.google.com) (66.249.92.168) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 13 Oct 2006 22:19:47 -0700 Received: by ug-out-1314.google.com with SMTP id k40so543256ugc for ; Fri, 13 Oct 2006 22:19:25 -0700 (PDT) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:date:from:x-mailer:reply-to:x-priority:message-id:to:cc:subject:in-reply-to:references:mime-version:content-type:content-transfer-encoding; b=oaXju/3QAHo56E3cUvFzD0dGqs7wz1X+B5vhGBuJR4RZUtQPUkjllIz4NFvwBBsX1vM5WTWof4u+pQdnjEKQhSopgphkqqqfwFimcaUBcdQj6S1aUx0+/y6Ni4RhESnC2YAvl/F9QF7TClnRP+OOjEKjnhoGCc8eay1AWeta7V0= Received: by 10.66.252.4 with SMTP id z4mr5191080ugh; Fri, 13 Oct 2006 22:19:25 -0700 (PDT) Received: from ppp236-233.pptp.mtu-net.ru ( [81.195.236.233]) by mx.google.com with ESMTP id k1sm1078957ugf.2006.10.13.22.19.24; Fri, 13 Oct 2006 22:19:24 -0700 (PDT) Date: Sat, 14 Oct 2006 09:19:28 +0400 From: Artem Vasiliev X-Mailer: The Bat! (v2.04.7) Personal Reply-To: Artem Vasiliev X-Priority: 3 (Normal) Message-ID: <1592028860.20061014091928@gmail.com> To: "Scott Smith" CC: java-user@lucene.apache.org Subject: Re: Large index question In-Reply-To: <55F9EF953014514EB6BEE1F5198CEEB44897CD@exchange.slc.mainstreamdata.com> References: <55F9EF953014514EB6BEE1F5198CEEB44897CD@exchange.slc.mainstreamdata.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org X-Spam-Rating: minotaur.apache.org 1.6.2 0/1000/N Hello Scott! I think your index is just not large really. My Sharehound's indexes of my corporate LAN is about 10G/10mlns of (really small) documents now, and queries get really little time, less than a second for non-sorted queries and some more for sorted. The machine is some P4 with 1G RAM. I use just FSDir. Best regards, Artem. SS> Supposed I want to index 500,000 documents (average document size is SS> 4kBs). Let's assume I create a single index and that the index is SS> static (I'm not going to add any new documents to it). I would guess SS> the index would be around 2GB. SS> Now, I do searches against this on a somewhat beefy machine (2GB RAM, SS> Core 2 Duo, Windows XP). Does anyone have any idea what kinds of search SS> times I can expect for moderately complicated searches (several sets of SS> keywords against several fields)? Are there things I can do to increase SS> search performance? For example, does Lucene like lots of RAM, lots of SS> CPU, faster HD, all of the above? Am I better splitting the index file SS> into 2 (N?) versions and search on multiple indexes simultaneously? SS> Anyone have any thoughts about this? SS> Scott --------------------------------------------------------------------- To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org For additional commands, e-mail: java-user-help@lucene.apache.org