lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Robert Engels" <reng...@ix.netcom.com>
Subject RE: Nio File Caching & Performance Test
Date Tue, 16 May 2006 19:21:48 GMT
The MMapDirectory works for really big indexes (larger than 2 gig), BUT if
the JVM does not have enough address space (32 bit JVM)it will not work.

-----Original Message-----
From: eks dev [mailto:eksdev@yahoo.co.uk]
Sent: Tuesday, May 16, 2006 2:20 PM
To: java-dev@lucene.apache.org
Subject: Re: Nio File Caching & Performance Test


Hi Robert,
I might be easily wrong, but I beleive I saw something on JIRA (or was it
bugzilla?) a long long time ago, where somebody made MMAP implementation for
really big indexes that works on 32 bit. I guess it is worth checking it.


----- Original Message ----
From: Yonik Seeley <yseeley@gmail.com>
To: java-dev@lucene.apache.org; rengels@ix.netcom.com
Sent: Tuesday, 16 May, 2006 6:10:07 PM
Subject: Re: Nio File Caching & Performance Test


On 5/16/06, Robert Engels <rengels@ix.netcom.com> wrote:
> SO, I would like to use a memory mapped reader, but I encounter OOM errors
> when mapping large files, due to running out of address space.

Pretty much all x86 servers sold are 64 bit capable now.
Run a 64 bit OS if you can :-)

> Has anyone found a solution for this? (A 2 gig index is not all that
> large...).

I guess one could try a hybrid approach... only mmap certain index
files that are critical for performance.


-Yonik
http://incubator.apache.org/solr Solr, the open-source Lucene search server

---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org

---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


Mime
View raw message