Mailing-List: contact solr-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: solr-user@lucene.apache.org
MIME-Version: 1.0
References: <027C1B99733BA64792B363A464CFBA46A0939E24@indiaserv04>
In-Reply-To: <027C1B99733BA64792B363A464CFBA46A0939E24@indiaserv04>
From: Binoy Dalal <binoydalal93@gmail.com>
Date: Thu, 03 Mar 2016 06:27:28 +0000
Message-ID: 
 <CALGoTy3=5FWWLmpABdd5_P_Cj8fL23Knkv5GuYKzhZHjPAAYCg@mail.gmail.com>
Subject: Re: Solr Configuration (Caching & RAM) for performance Tuning
To: "solr-user@lucene.apache.org" <solr-user@lucene.apache.org>
Content-Type: multipart/alternative; boundary=001a113fe1be48e749052d1f18fd

--001a113fe1be48e749052d1f18fd
Content-Type: text/plain; charset=UTF-8

1) Experiment with the autowarming settings in solrconfig.xml. Since in
your case, you're indexing so frequently consider setting the count to a
low number, so that not a lot of time is spent warming the caches.
Alternatively if you're not very big on initial query response times being
small, you could turn off auto warming all together.
Also how are your commit settings configured?
Do you do a hard commit every 10 seconds or do you have soft committing
enabled?

2) 50Gb memory is way to high to assign to just solr and it is unnecessary.
Solr loads your index into the OS cache. The index is not held in the JVM
heap.
So it is essential that your OS have enough free memory available to load
the entire index.
Since you're only seeing about a 2gb use of your JVM memory, set your heap
size to something around 4gbs.

Also, how big is your index?

On Thu, 3 Mar 2016, 11:39 Maulin Rathod, <mrathod@asite.com> wrote:

> Hi,
>
> We are using Solr 5.2 (on windows 2012 server/jdk 1.8) for document
> content indexing/querying. We found that querying slows down intermittently
> under load condition.
>
> In our analysis we found two issues.
>
> 1) Solr is not effectively using caching.
>
> Whenever new document indexed, it opens new searcher and hence cache will
> become invalid (as cache was associated with old Index Searcher). In our
> scenario, new documents are indexed very frequently (at least 10 document
> are indexed per minute). So effectively cache will not be useful as it will
> open new searcher frequently to make new documents available for searching.
> How can improve caching usage?
>
>
> 2) RAM is not utilized
>
> We observed that Solr is using only 1-2 GB of heap even though we have
> assign 50 GB. Seems like it is not loading index into RAM which leads to
> high IO. Is it possible to configure Solr to fully load indexes in memory?
> Don't find any documentation about this. How can we increase RAM usage to
> improve Solr performance?
>
>
> Regards,
>
> Maulin
>
> [CC Award Winners 2015]
>
> --
Regards,
Binoy Dalal

--001a113fe1be48e749052d1f18fd--