Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: java-user@lucene.apache.org
Received-SPF: pass (athena.apache.org: domain of luz290@gmail.com designates
 209.85.132.248 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=beta;
        h=received:message-id:date:from:to:subject:in-reply-to:mime-version:content-type:references;
        b=gP5NdPkNQt9QNNdhO4/Ir2R7MHOWrqjiPSa4XcAf1PbBQDmtfRK1KOo4WX5a0YnkFAZlnENyqF6nwZBufo/qqsVGglOFBnwKJKht3CsSz+l3+5yBv9QTSZ4nAlhuOcvPAHk7yHBkKtVzI6UKtectT4WSCFzqxT1S8TCSYEpqcFA=
Message-ID: <cec089090708120501y407c49dci87265f0a9b8149b8@mail.gmail.com>
Date: Sun, 12 Aug 2007 08:01:28 -0400
From: "lucene user" <luz290@gmail.com>
To: java-user@lucene.apache.org
Subject: Re: Amount of RAM needed to support a growing lucene index?
In-Reply-To: <F2EB50D7-0F87-47A2-8A7A-6C4CD282DB4E@gmail.com>
MIME-Version: 1.0
Content-Type: multipart/alternative;
	boundary="----=_Part_34187_26954178.1186920088246"
References: <cec089090708120003j48c2e253yca5a814e86f5b8ad@mail.gmail.com>
	 <F2EB50D7-0F87-47A2-8A7A-6C4CD282DB4E@gmail.com>

------=_Part_34187_26954178.1186920088246
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

Thanks, Karl.

Do you know if 290k articles and 234 million words is a large lucene index
or a medium one? Do people build them this big all the time?

Thanks!

On 8/12/07, karl wettin <karl.wettin@gmail.com> wrote:
>
>
> 12 aug 2007 kl. 09.03 skrev lucene user:
>
> > If I have an index with 111k articles and 90 million words indexed,
> > how much
> > RAM should I have to get really fast access speeds?
> >
> > If I have an index with 290k articles and 234 million words
> > indexed, how
> > much RAM should I have to get really fast access speeds?
>
> Define really fast.
>
> I say you need 1.3x as much RAM as the size of your FSDirectory to
> ensure that the file system cache is never flushed out. But it also
> depends on user load. Each thread consumes RAM and CPU.
>
> In order to really find out, setup the benchmarker to run on your
> index, and limit the amount of memory your file system chache and JVM
> is allowed.
>
> > Any other advice about sizing a server?
> > What other info do you need to have to help size the server?
>
> Sizing?
>
> > Does it matter if the server has a 64 bit processor?
>
> In a 64 bit environment a reference to an instance consumes twice as
> much RAM as in a 32 bit environment. It should not affect a file
> centric Lucene store (Directory), Your OS and your application that
> use Lucene might be consuming some more resources though. Again,
> benchmark.
>
> > Speed of processor important?
>
> Yes.
>
> > Speed of disks?
>
> May or may not be intersting depending on how much RAM you have.
>
>
>
> --
> karl
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
>

------=_Part_34187_26954178.1186920088246--