Return-Path: Delivered-To: apmail-lucene-java-user-archive@www.apache.org Received: (qmail 37497 invoked from network); 26 Apr 2006 18:50:54 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (209.237.227.199) by minotaur.apache.org with SMTP; 26 Apr 2006 18:50:54 -0000 Received: (qmail 54877 invoked by uid 500); 26 Apr 2006 18:50:48 -0000 Delivered-To: apmail-lucene-java-user-archive@lucene.apache.org Received: (qmail 54851 invoked by uid 500); 26 Apr 2006 18:50:48 -0000 Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: java-user@lucene.apache.org Delivered-To: mailing list java-user@lucene.apache.org Received: (qmail 54840 invoked by uid 99); 26 Apr 2006 18:50:47 -0000 Received: from asf.osuosl.org (HELO asf.osuosl.org) (140.211.166.49) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 26 Apr 2006 11:50:47 -0700 X-ASF-Spam-Status: No, hits=1.3 required=10.0 tests=RCVD_IN_BL_SPAMCOP_NET X-Spam-Check-By: apache.org Received-SPF: neutral (asf.osuosl.org: local policy) Received: from [207.115.57.32] (HELO ylpvm01.prodigy.net) (207.115.57.32) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 26 Apr 2006 11:50:46 -0700 Received: from pimout6-ext.prodigy.net (pimout6-int.prodigy.net [207.115.4.22]) by ylpvm01.prodigy.net (8.12.10 outbound/8.12.10) with ESMTP id k3QIoKFm015285 for ; Wed, 26 Apr 2006 14:50:21 -0400 X-ORBL: [69.228.218.244] Received: from [192.168.168.15] (adsl-69-228-218-244.dsl.pltn13.pacbell.net [69.228.218.244]) by pimout6-ext.prodigy.net (8.13.6 out.dk/8.13.6) with ESMTP id k3QIoLD1076170; Wed, 26 Apr 2006 14:50:22 -0400 Message-ID: <444FC0ED.4070602@apache.org> Date: Wed, 26 Apr 2006 11:50:21 -0700 From: Doug Cutting User-Agent: Mozilla Thunderbird 1.0.7 (X11/20051013) X-Accept-Language: en-us, en MIME-Version: 1.0 To: java-user@lucene.apache.org Subject: Re: RAM Directory / querying Performance issue References: <20060426135051.4835.qmail@web60815.mail.yahoo.com> In-Reply-To: <20060426135051.4835.qmail@web60815.mail.yahoo.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 8bit X-Virus-Checked: Checked by ClamAV on apache.org X-Spam-Rating: minotaur.apache.org 1.6.2 0/1000/N Is this markedly faster than using an MMapDirectory? Copying all this data into the Java heap (as RAMDirectory does) puts a tremendous burden on the garbage collector. MMapDirectory should be nearly as fast, but keeps the index out of the Java heap. Doug zzzzz shalev wrote: > I've rewritten the RAM DIR to supprt 64 bit (still havent had time to add this to lucene, hopefully in the coming months when i have a free second) > > My question: > > i have a machine with 4 GB RAM > > i have a 3GB index file, > > i successfully load the 3GB index into memory, > > the first few queries run with normal response time, > > but very quickly response time becomes unbearably slow (webloading with 1 con user), > > how are queries expanded in memory when run (how much memory do they use up)? > > could this be an issue of the queries themselves talking up large chunks of RAM? > > > > > > > > --------------------------------- > Blab-away for as little as 1�/min. Make PC-to-Phone Calls using Yahoo! Messenger with Voice. --------------------------------------------------------------------- To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org For additional commands, e-mail: java-user-help@lucene.apache.org