lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From scott chu (朱炎詹) <>
Subject Re: What is the maximum number of documents that can be indexed ?
Date Thu, 14 Oct 2010 01:45:18 GMT
Solr is designed in scalable aritechture. So you question depends on how 
many resources (cpu, memory, space, etc.) you have to scale Solr how high 
(within a single machine), how wide (how fast a request you wish to response 
to user using replication), and how deep (how many slices/partition (Solr's 
designers call them 'shard') you wish to split for a huge size index, if 

In my experience, to analyaze the data itself & collect usage/guess possible 
usage of  your users is more important. I can share one of my experience 
with you. Initially we try to build 1 Solr Architecture to service all the 
search requests from our users. Then we re-analyze the past usage of search 
of our users, we found over 65% of all searches concentrates on recent 
1-week news. So we split to 2 Solr with 2 physical architecture. 70% of the 
machines are invested on 1st Solr to service recent 1-week news searches.

Although I believe there must be a technicall maximum parameters there, I 
don't think we'll reach that limit in normal usage.

----- Original Message ----- 
From: "Otis Gospodnetic" <>
To: <>
Cc: <>
Sent: Thursday, October 14, 2010 8:58 AM
Subject: Re: What is the maximum number of documents that can be indexed ?

> Marco (use solr-user@lucene list to follow up, please),
> There are no precise answers to such questions.  Solr can keep indexing. 
> The
> limit is, I think, the available disk space.  I've never pushed Solr or 
> Lucene
> to the point where Lucene index segments would become a serious pain, but 
> even
> that can be controlled.  Same thing with number of open files, large file
> support, etc.
> Otis
> ----
> Sematext :: :: Solr - Lucene - Nutch
> Lucene ecosystem search ::
>>From: Marco Ciaramella <>
>>Sent: Wed, October 13, 2010 6:19:15 PM
>>Subject: What is the maximum number of documents that can be indexed ?
>>Hi all,
>>I am working on a performance specification document on a 
>>application; this document is intended for the final customer. My question 
>>what is the maximum number of document I can index assuming 10 or 20kbytes 
>>each document?
>>I could not find a precise answer to this question, and I tend to consider 
>>Solr index can be virtually limited only by the JVM, the Operating System
>>(limits to large file support), or by hardware constraints (mainly RAM, 
>>etc. ...


Checked by AVG -
Version: 9.0.862 / Virus Database: 271.1.1/3193 - Release Date: 10/13/10 

View raw message