lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Walter Underwood <wun...@wunderwood.org>
Subject Re: Some performance questions....
Date Mon, 12 Mar 2018 17:26:21 GMT
Benchmark with production logs. Replay them at a constant request rate. Measure the response
time and look at the median and 90th or 95th percentile. Do not use the average response time,
because that will be thrown off by outliers.

It is best to run a few thousand warming queries before starting the measured benchmark run.
That will load some results into the caches and will also load the index files into OS file
buffers.

Restart the processes between benchmark runs to clear the caches.

My benchmark runs are about an hour long, not counting warming and analysis.

I always configure Solr with enough RAM that all the indexes fit into OS file buffers. With
that, disk speed only matters for startup and indexing.

wunder
Walter Underwood
wunder@wunderwood.org
http://observer.wunderwood.org/  (my blog)

> On Mar 12, 2018, at 10:16 AM, BlackIce <blackice2k4@gmail.com> wrote:
> 
> OK, so we're gone nowhere,  since I've already lost lots of time...  A few
> days more or less won't make a difference....  I'd be willing to benchmark
> if some tells me how to.
> 
> 
> Greetz
> 
> On Mar 12, 2018 7:17 AM, "Deepak Goel" <deicool@gmail.com> wrote:
> 
>> Now you are mixing your original question about performance with
>> reliability
>> 
>> On 12 Mar 2018 02:29, "BlackIce" <blackice2k4@gmail.com> wrote:
>> 
>>> Second to this wouldn't 4 Solr instances each with its own HD be fault
>>> tolerant? vs. one solr instance with 4 HD's in RAID 0? Plus to his comes
>>> the storage capacity, I need the capacity of those 4 drives... the more I
>>> read.. the more questions....
>>> 
>>> On Sun, Mar 11, 2018 at 9:43 PM, BlackIce <blackice2k4@gmail.com> wrote:
>>> 
>>>> Thnx for the pointers.
>>>> 
>>>> I haven't given much thought to Solr, asides shemal.xml and
>>> solrconfig.xml
>>>> and I'm just diving into a bit more deeper stuff!
>>>> 
>>>> Greetz
>>>> 
>>>> RRK
>>>> 
>>>> On Sun, Mar 11, 2018 at 8:58 PM, Deepak Goel <deicool@gmail.com>
>> wrote:
>>>> 
>>>>> To rephrase your Question
>>>>> 
>>>>> "Does Solr do well with Scale-up or Scale-out?"
>>>>> 
>>>>> Are there any Performance Benchmarks for the same out there supporting
>>> the
>>>>> claim?
>>>>> 
>>>>> On 11 Mar 2018 23:05, "BlackIce" <blackice2k4@gmail.com> wrote:
>>>>> 
>>>>>> Hi,
>>>>>> 
>>>>>> I have some questions regarding performance.
>>>>>> 
>>>>>> Lets says I have a dual CPU with a total of 8 cores and 24 GB RAM
>> for
>>> my
>>>>>> Solr and some other stuff.
>>>>>> 
>>>>>> Would it be more beneficial to only run 1 instance of Solr with the
>>>>>> collection stored on 4 HD's in RAID 0?? Or.... Have several Virtual
>>>>>> Machines each running of its own HD, ie: Have 4 VM's running Solr?
>>>>>> 
>>>>>> Any Thoughts?
>>>>>> 
>>>>>> Thank you!
>>>>>> 
>>>>>> RRK
>>>>>> 
>>>>> 
>>>> 
>>>> 
>>> 
>> 


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message