lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Chris Hostetter <hossman_luc...@fucit.org>
Subject Re: Lucene indices for Archiva (The Maven Repository Manager)
Date Sat, 23 Sep 2006 20:01:10 GMT

: I'd play with having the base indexed download, and with deltas sent
: down as compressed plain-text files.  Client/IDE side can then
: uncompress + process + delete + add + be happy.

if you really needed the indexing to be done centrally, you could just
ship any new segments each time the index is modified, along with the
current segments file and have a little utility on the clients thta
deletes any segments no longer in use .. but eventually you are going to
want to optimize the index, and then you'll have to ship the whole thing
out to everybody again.

I'm with Otis ... shipping "data files" with instructions for
adding/removing documents represented as strings and letting code on the
client build the index is probably going to be the most efficient way ot
get the data out to all of your clients.

----- Original Message ----
From: Jason van Zyl <jason@maven.org>
To: java-dev@lucene.apache.org
Sent: Saturday, September 23, 2006 10:43:00 AM
Subject: Lucene indices for Archiva (The Maven Repository Manager)

Hi,

We have happily been using Lucene in Archiva and we're ready to use
Lucene in a more advanced for efficiency.

Currently we create a number of indices for all the information in
the Maven repository and we are placing everything into one Lucene
index. Right now the index is 180mb uncompressed and ~20mb when
compressed.

We would like to create a base index and then provide index updates
on a daily, weekly, and monthly basis so that people don't have to
drag down the whole index down again and again. The primary target
for this index is IDE integration which uses Maven repository
information to guide users in selecting dependencies.

Has anyone implemented something like this? Any guidelines or tips we
should follow?

Jason van Zyl
jason@maven.org




---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org




:
: ---------------------------------------------------------------------
: To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
: For additional commands, e-mail: java-dev-help@lucene.apache.org
:



-Hoss


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


Mime
View raw message