Return-Path: Delivered-To: apmail-lucene-java-user-archive@www.apache.org Received: (qmail 90273 invoked from network); 8 Jul 2005 07:29:26 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (209.237.227.199) by minotaur.apache.org with SMTP; 8 Jul 2005 07:29:26 -0000 Received: (qmail 59856 invoked by uid 500); 8 Jul 2005 07:29:17 -0000 Delivered-To: apmail-lucene-java-user-archive@lucene.apache.org Received: (qmail 59830 invoked by uid 500); 8 Jul 2005 07:29:17 -0000 Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: java-user@lucene.apache.org Delivered-To: mailing list java-user@lucene.apache.org Received: (qmail 59815 invoked by uid 99); 8 Jul 2005 07:29:16 -0000 Received: from asf.osuosl.org (HELO asf.osuosl.org) (140.211.166.49) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 08 Jul 2005 00:29:16 -0700 X-ASF-Spam-Status: No, hits=0.0 required=10.0 tests=RCVD_BY_IP,SPF_HELO_PASS,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (asf.osuosl.org: domain of clamprecht@gmail.com designates 64.233.170.204 as permitted sender) Received: from [64.233.170.204] (HELO rproxy.gmail.com) (64.233.170.204) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 08 Jul 2005 00:29:12 -0700 Received: by rproxy.gmail.com with SMTP id z35so322920rne for ; Fri, 08 Jul 2005 00:29:10 -0700 (PDT) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:reply-to:to:subject:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=Hb5aZ65/HrdrYLvOnRL6j1TjAy8zW4LOg8Mf7by2hmht243JVv5doykGw3LBG4fhl5fm0mWBzxB4PDvac+r79PtjaXPz0wT75zjeEtYSgIhBcQjE8F84j4ot+qBxpVsuM2fCiQYjr9PgOebAfkSS9Si4NrtTcpyp7HkegMOAhvM= Received: by 10.39.3.1 with SMTP id f1mr1552114rni; Fri, 08 Jul 2005 00:29:10 -0700 (PDT) Received: by 10.38.104.23 with HTTP; Fri, 8 Jul 2005 00:29:10 -0700 (PDT) Message-ID: <88c6a672050708002955c8cafa@mail.gmail.com> Date: Fri, 8 Jul 2005 02:29:10 -0500 From: Chris Lamprecht Reply-To: Chris Lamprecht To: java-user@lucene.apache.org Subject: Re: Loading large index into RAM In-Reply-To: <1120781067.1592630318.22753.sendItem@bloglines.com> Mime-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Content-Disposition: inline References: <1120781067.1592630318.22753.sendItem@bloglines.com> X-Virus-Checked: Checked by ClamAV on apache.org X-Spam-Rating: minotaur.apache.org 1.6.2 0/1000/N If you're under an x86_64 machine (AMD opteron, for instance), you may be able to set your JVM heap this large. But if you have 6GB RAM, you might try keeping your JVM small (under 1GB), and letting linux's filesystem cache do the work. Lucene searches are often CPU-bound (during the search phase anyway) and loading into a RAMDirectory won't help here. It's the second "phase" of search -- pulling all the lucene Documents from disk -- that's often I/O bound, and can benefit from being in RAM. -chris On 8 Jul 2005 00:04:27 -0000, yahootintin.11533894@bloglines.com wrote: > Is it possible to use a RAMDirectory to load a 5 GB index into RAM on Lin= ux? > I have access to a server with 6 GB of RAM and will try it next week but > I've heard that Java on Linux may only support up to 2 GB of RAM per proc= ess. > Anyone already tried this? >=20 > Thanks. >=20 > --------------------------------------------------------------------- > To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org > For additional commands, e-mail: java-user-help@lucene.apache.org >=20 > --------------------------------------------------------------------- To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org For additional commands, e-mail: java-user-help@lucene.apache.org