lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Peter Sturge <peter.stu...@googlemail.com>
Subject Remplicas not deleting old index.* folders
Date Sat, 03 Apr 2010 14:32:57 GMT
Hi,

I've got a question regarding remplication index.<timestamp> folders - can
anyone help?

Note: There is a somewhat related thread here:

http://www.lucidimagination.com/search/document/15a740cca17eed56/solr_1_4_replication_index_directories#e4b0af2f321204d7

I have a remplica that is pushed fetchindex commands on a periodic basis
when it's time to remplicate (i.e. remplication is managed by the server
application, not by remplica polling).
The master that is sending these fetchindex commands tells the remplica to
remplicate one of its cores, but which core it is changes over time.
This has the effect of the remplica periodically saying: 'oh, these files
are totally different, I'll create a brand new index.<timestamp> folder,
upload the master's files to it and reload'. On its own, this is absolutely
fine.
The problem is that any previous index folders are left lying around - i.e.
not deleted, so eventually (quickly for large indexes) the remplica runs out
of disk space.

Is there a way to either tell the remplica to always 'reuse' the /index
folder (ideal) regardless of file name/content, or set its deletionPolicy or
similar so that it deletes any and all 'old' index.* folders and only keeps
the current one?


Many thanks,
Peter

<forgive my anti-spam spelling>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message