lucy-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Nathan Kurz <n...@verse.com>
Subject Re: [lucy-dev] Re: ClusterSearcher
Date Sat, 26 Nov 2011 09:48:38 GMT
Dan --

I took a glance.  Sounds promising.  Could you talk a bit about the use
case you at anticipating?  What are you indexing?  How fast is it
changing?  Do the shards fit in memory?  What's a ballpark for the searches
per second you'd like to handle?

My first thought is that you may be able to trade off some latency for
increased throughput by sticking with partially serialized requests if you
were able to pass a threshold score along to each node/shard so you could
speed past low scoring results.  But this brings up Marvin's points about
how to handle distributed TF/IDF...

--nate

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message