Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: java-user@lucene.apache.org
Received-SPF: pass (athena.apache.org: domain of uwe@thetaphi.de designates
 85.25.204.22 as permitted sender)
From: "Uwe Schindler" <uwe@thetaphi.de>
To: <java-user@lucene.apache.org>
References: 
 <CAFAd71V9j=52ytM1jJeZe4oZ3RaY5nCghL2_m2w-Xxf3e8RtqQ@mail.gmail.com>
In-Reply-To: 
 <CAFAd71V9j=52ytM1jJeZe4oZ3RaY5nCghL2_m2w-Xxf3e8RtqQ@mail.gmail.com>
Subject: RE: how to "load" mmap directory into memory?
Date: Wed, 3 Dec 2014 11:54:27 +0100
Message-ID: <03c501d00ee7$820feb60$862fc220$@thetaphi.de>
MIME-Version: 1.0
Content-Type: text/plain;
	charset="utf-8"
Content-Transfer-Encoding: quoted-printable
Thread-Index: AQGDQ8HKaWBrfCODvQkLYD8hwNKaO50XRA4A
Content-Language: de

Hi,

the first searches are always slower, which is not only caused by the FS =
cache. In general, searchers must be warmed, so you execute a set of =
search queries or calculate facets initially after opening (or =
reopening) an IndexReader. This will have the side effect of also =
warming the disk cache. But it also initializes all required structures =
inside Lucene. So instead of forcefully loading the whole index files =
into fs-cache, its better to use =
IndexReaderWarmer(http://lucene.apache.org/core/4_10_2/core/org/apache/lu=
cene/index/IndexWriter.IndexReaderWarmer.html), which can be used with =
SearcherManager in Lucene to warm searchers.

Uwe

-----
Uwe Schindler
H.-H.-Meier-Allee 63, D-28213 Bremen
http://www.thetaphi.de
eMail: uwe@thetaphi.de


> -----Original Message-----
> From: Li Li [mailto:fancyerii@gmail.com]
> Sent: Wednesday, December 03, 2014 3:46 AM
> To: java-user@lucene.apache.org
> Subject: how to "load" mmap directory into memory?
>=20
> I am using mmap fs directory in lucene. My index is small (about 3GB =
in disk)
> and I have plenty of memory available. The problem is that when the =
term is
> first queried, it's slow. How can I "load" all directory into memory? =
One
> solution is using many query to "warm" it up. But I can't query all =
terms and
> maybe some terms are still not in memory. Any other methods?
> If I write a script(or java program) to read the index file, will it =
load all into
> memory if I have enough memory?
>=20
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org