lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From markharw...@yahoo.co.uk
Subject RE: Lucene scalability/clustering
Date Thu, 26 Feb 2004 21:38:17 GMT
I tend to think of scaling in two dimensions: scaling by volumes of users and scaling by volumes
of data. The former is addressed through replicated indexes 
and the latter by segmented indexes. 
Distribute replicated segments across multiple boxes and create a broker which
a)Determines which segments to query
b)Load balances query requests across the replicated servers for each segment
c) Merges responses

Make sure your communications are batched to avoid too much fine-grained "chatter".

This is the basis of a scalable architecture.

Cheers
Mark


---------------------------------------------------------------------
To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: lucene-user-help@jakarta.apache.org


Mime
View raw message