lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Erick Erickson <erickerick...@gmail.com>
Subject Re: Solr Index linear growth - Performance degradation.
Date Mon, 13 Aug 2012 23:19:39 GMT
Instant reactions:

1> that's probably too much memory. Try, as Lance said, 1/2 of your
memory. Uwe Schindler wrote an excellent blog about this issue as it
relates to MMapDirectory
http://blog.thetaphi.de/2012/07/use-lucenes-mmapdirectory-on-64bit.html

2> You've doubled the number of docs on the server and you're seeing a
doubling of the response time, right? On average, the number of
documents that have to be scored has also doubled, so I'm not entirely
surprised. If everything is in memory (which it sounds like it may
well be) then this isn't particularly surprising.

3> One note of caution. Saying "a 14 GB index (or 28G index) isn't
very meaningful. The *.fdt and *.fdx files in your index directory are
where the verbatim copy of the data is stored for those fields where
stored="true" in your schema. The contents of these files are almost
totally irrelevant to the memory requirements for searching. I've seen
these files range form < 5% of the index to over 80%.

Best
Erick

On Mon, Aug 13, 2012 at 4:40 PM, feroz_kh <feroz_kh@yahoo.com> wrote:
> Here's few list of queries
> -------------------------------------------
> parallel zur xml beschreibungsdatei gibt es eine
> die verbindung zwischen beiden sei ten geschieht
> die owner klasse muss sich aus der
> benutzer ein oder mehrere lieblingsfarben ausw hlen kann
> found sample questions at http bjs ojp
> but more important parents need to keep
> -----------------------------------
> Here's the jvm ram assignment
> -Xms24576m -Xmx24576m -XX:NewSize=6168m -XX:MaxNewSize=6168m
> -XX:MaxPermSize=1024m
> I believe that's enough assigned there...
> ---------------------------------
> I am not dealing with adding new documents here....
> Just testing the solr index search - i just the have the indexes.
> For 14GB index the RAM cache gets filled with 14 GB around
> For 28GB index the RAM cache gets filled with 28GB around
> The Document cache size is 200MB max and initial 20MB.
>
>
>
> --
> View this message in context: http://lucene.472066.n3.nabble.com/Solr-Index-linear-growth-Performance-degradation-tp4000934p4001011.html
> Sent from the Solr - User mailing list archive at Nabble.com.

Mime
View raw message