Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: java-user@lucene.apache.org
Received-SPF: neutral (nike.apache.org: local policy)
Message-ID: <9ac0c6aa0812200125j6686dcdcn975bcf77056843ff@mail.gmail.com>
Date: Sat, 20 Dec 2008 04:25:13 -0500
From: "Michael McCandless" <lucene@mikemccandless.com>
To: java-user@lucene.apache.org
Subject: Re: Default and optimal use of RAMDirectory
In-Reply-To: 
 <OF09F34078.31E2805C-ON48257521.005922F9-48257521.005922FA@lawson.com>
MIME-Version: 1.0
Content-Type: multipart/alternative;
	boundary="----=_Part_60950_28744869.1229765113496"
References: 
 <OF09F34078.31E2805C-ON48257521.005922F9-48257521.005922FA@lawson.com>

------=_Part_60950_28744869.1229765113496
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

Actually, things have improved since LIA1 was written a few years ago:
IndexWriter now does a good job managing the RAM buffer you assign to
it, so you should not see much benefit by doing your own buffering
with RAMDirectory (and if you somehow do, I'd like to know about
it!).

Instead you should call IndexWriter.setRAMBufferSizeMB.

Also, FSDirectory does no RAM buffering on its own.

See here for further ways to tune for indexing throughput:

http://wiki.apache.org/lucene-java/ImproveIndexingSpeed

Mike

<Joseph.Syjuco@ph.lawson.com> wrote:

>
> Hi all,
>
> First of I'd like to say I'm quite pleased to be a part of this mailing
> list - its even more exciting to know that we have Otis G. and Erik H.,
> authors of (at least in my opinion) the Lucene Bible - Lucene in Action,
> actively answering all these inquiries =)
>
> We're currently in the initial stages of implementing lucene as part of our
> product and one problem that we need to resolve is optimizing lucene.  I've
> been reading Lucene in Action book and one of the tips for optimizing
> lucene indexing is by using RAMDirectory as a buffer before writing to
> FSDirectory.  According to the book, this is done internally and
> automatically when I use FSDirectory.  My questions are 1.) What's the
> default implementation/ computation used in allocating RAMdirectory when we
> implement FSDirectory and 2.) What's the optimal way of customizing
> RAMDirectory usage - any tips on how to do it.
>
> BTW, we're using Lucene 2.3.2
>
> Thanks for all the help
>
> Joseph
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
>

------=_Part_60950_28744869.1229765113496--