lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Toke Eskildsen ...@statsbiblioteket.dk>
Subject Re: Determining the Number of Solr Shards
Date Fri, 09 Jan 2015 09:14:42 GMT
On Thu, 2015-01-08 at 22:55 +0100, Nishanth S wrote:
> Thanks guys for your inputs I would be looking at around 100 Tb of total
>  index size  with 5100 million documents [...]

That is a large corpus when coupled with your high indexing & QPS
requirements. Are the queries complex too? Will you be doing non-trivial
faceting?

Your requirements are so high that any guesswork at this point is likely
to be wrong by an order of magnitude. What is very certain is that you
will need serious hardware. Your starting point should not be to try and
estimate the number of shards. Start by building a test setup.

- Toke Eskildsen



Mime
View raw message