lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Michael McCandless <luc...@mikemccandless.com>
Subject Re: lots of .cfs (compound files) in the index directory
Date Thu, 15 Mar 2012 12:21:28 GMT
Hmm, that's odd...

Can you set IndexWriter's infoStream and then capture the output while
doing the small writes every few seconds and post back?

If you run CheckIndex on the index does it also report ~3000 segments?

Mike McCandless

http://blog.mikemccandless.com

On Thu, Mar 15, 2012 at 7:14 AM, Tim Bogaert <bogguard@gmail.com> wrote:
> Hi,
>
> We migrated our project to Lucene 3.5 and used the TieredMergePolicy with
> all its defaults.
> Our project contains a relatively small index (+-90MB) and gets small
> writes every few seconds.
> The behaviour we see is that when we reindex everything works great and
> performant,
> but when we keep the index running for some days we see a lot (+-3000) of
> very small .cfs files (between 1KB and 10KB) are being generated and the
> performance drops significantly.
> Reïndexing solves the problem, but this shouldn't be the solution.
>
> Is there a way to change the behaviour of the .cfs files. I noticed you can
> fully disable it, but I read that this isn't adviced.
>
> Kind regards,
> Bogguard

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


Mime
View raw message