lucene-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Solr Wiki] Trivial Update of "SolrPerformanceData" by TokeEskildsen
Date Fri, 19 Sep 2014 20:57:07 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Solr Wiki" for change notification.

The "SolrPerformanceData" page has been changed by TokeEskildsen:
https://wiki.apache.org/solr/SolrPerformanceData?action=diff&rev1=28&rev2=29

Comment:
Corrected library->archive

  
  Search is handled by a single dedicated 16 core CentOS machine with 256GB RAM (currently
~130GB free for disk cache). Each shard has its own Solr instance running in Tomcat with a
Xmx of 9GB and resides on a dedicated SSD (Samsung 840). All instances are in a single SolrCloud.
There are 25 SSDs in the machine and it is currently undecided if the setup will be scaled
up (more RAM, more SSDs) or out (another similar machine), when we reach that number of shards.
  
- Access to the library is limited and at most 2 or 3 users are active at a time. Searches
are faceted on 6 fields: URL (nearly 5 billion unique values), domain, host and 3 smaller
ones. With Solr 4.8 and [[https://issues.apache.org/jira/browse/SOLR-5894|SOLR-5894]], median
and average response times during load testing are currently below ½ second and expected
to stay below 1 second as the index grows. Special searches, such as *:*, take up to 2 minutes.
For non-faceted searches, IOWait get as high as 10%. For faceted searches, IOWait stays below
0.5% and CPU-load is high. It has not been determined if the high CPU-load is due to processing
(easily scalable) or memory access congestion (not easily scalable). See [[http://sbdevel.wordpress.com/2014/09/11/even-sparse-faceting-is-limited/|Even
sparse faceting is limited]] for most recent performance figures.
+ Access to the archive is limited and at most 2 or 3 users are active at a time. Searches
are faceted on 6 fields: URL (nearly 5 billion unique values), domain, host and 3 smaller
ones. With Solr 4.8 and [[https://issues.apache.org/jira/browse/SOLR-5894|SOLR-5894]], median
and average response times during load testing are currently below ½ second and expected
to stay below 1 second as the index grows. Special searches, such as *:*, take up to 2 minutes.
For non-faceted searches, IOWait get as high as 10%. For faceted searches, IOWait stays below
0.5% and CPU-load is high. It has not been determined if the high CPU-load is due to processing
(easily scalable) or memory access congestion (not easily scalable). See [[http://sbdevel.wordpress.com/2014/09/11/even-sparse-faceting-is-limited/|Even
sparse faceting is limited]] for most recent performance figures.
  

Mime
View raw message