lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Toke Eskildsen ...@statsbiblioteket.dk>
Subject Re: Pressed optimize and now SOLR is not indexing while optimize is going on
Date Tue, 06 Oct 2015 10:55:21 GMT
On Mon, 2015-10-05 at 17:26 -0400, Siddhartha Singh Sandhu wrote:
> Following up on that: Would having an SSD make considerable difference in
> speed?

Yes, but only to a point.

The UK Web Archive has done some tests on optimizing indexes on both
spinning drives and SSDs: 
https://github.com/ukwa/shine/tree/master/python/test-logs

With spinning drives, their machines maxed out on IOWait. With SSD, the
machine maxed out on CPU. That might sound great, but the problem is
that optimizing on a single shard is single threaded (at least for Solr
4.10.x), so if there is only a single shard on the machine, only 1 CPU
is running at full tilt. There is always a bottleneck.

What might help is that the SSD (probably) does not get bogged down by
the process, so it should be much better at handling other requests
while the optimization is running.

- Toke Eskildsen, State and University Library, Denmark



Mime
View raw message