lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Scott Sellman" <ssell...@valueclick.com>
Subject RE: Clustering Lucene with 40 Servers
Date Wed, 27 Dec 2006 16:54:10 GMT
Sorry if this seems naïve (I am new to Lucene), but why not keep one copy of the Lucene index
on a NAS and have it shared by all servers?  

-----Original Message-----
From: Biggy [mailto:biggy97@web.de] 
Sent: Wednesday, December 27, 2006 7:57 AM
To: java-user@lucene.apache.org
Subject: Clustering Lucene with 40 Servers


I'm currently investigating the best ways of clustering Lucene.
I've heard of both Solr, Terracotta but do not know how well they scale.
Their examples talk of a 4 node cluster. This is way too small for my needs.

I have 30x JVMs each handling 3 requests/sec and each having their own
Lucene index. The index changes are propagated to the cluster members using
JGroups messages. This solution has more than reached its limit as JGroups
has become unstable and a source of many JVMs crashes. Based on current
traffic trends I anticipate needing to upgrade to 40x + JVMS very soon.

Can anybody suggest a way to effectivily cluster / replicate document
changes ?

P.S.: 
JMS is not a possible solution as this was the prior JGroups solution. We
had too many memory problems/queue full etc crashing the servers thereafter.

-- 
View this message in context: http://www.nabble.com/Clustering-Lucene-with-40-Servers-tf2886546.html#a8064135
Sent from the Lucene - Java Users mailing list archive at Nabble.com.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


Mime
View raw message