lucene-solr-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Solr Wiki] Update of "LotsOfCores" by ShalinMangar
Date Fri, 24 Jul 2009 10:13:21 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Solr Wiki" for change notification.

The following page has been changed by ShalinMangar:
http://wiki.apache.org/solr/LotsOfCores

The comment on the change is:
Details on supporting thousands of cores in a solr instance

New page:
<!> ["Solr1.5"]

[[TableOfContents]]

Solr, currently, is not very suitable for a large number of homogeneous cores where you require
fast/frequent loading/unloading of cores. Usually a core is required to be loaded just to
fire a search query or to just index one document.

The requirements of such a system are:
 1. Very efficient loading of cores - Solr cannot afford to read and parse and create Schema,
SolrConfig objects for each core every time the core has to be loaded
 1. Lazy load cores - Provide a way to START/STOP core.
 1. Automatic loading of cores - Start a core automatically if a request comes in for a "stopped"
core.
 1. LRU Core Loading/Unloading - As there are a large number of cores, all the cores cannot
be kept loaded always. There has to be an upper limit beyond which we need to unload a few
cores.
 1. Automatic allotment of dataDir for cores - If the number of cores is too high, all the
cores' dataDirs cannot live in the same directory. There is an upper limit on the number of
directories you can create in a directory w/o affecting performance.

Mime
View raw message