lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Otis Gospodnetic <otis_gospodne...@yahoo.com>
Subject Re: Control segment size
Date Thu, 23 Apr 2009 17:26:44 GMT

Hi,

You are looking for maxMergeDocs, I believe.

Otis
--
Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch



----- Original Message ----
> From: vivek sar <vivextra@gmail.com>
> To: solr-user@lucene.apache.org
> Sent: Thursday, April 23, 2009 1:08:20 PM
> Subject: Control segment size
> 
> Hi,
> 
>   Is there any configuration to control the segments' file size in
> Solr? Currently, I've an index (70G) with 80 segment files and one of
> the file is 24G. We noticed that in some cases commit takes over 2
> hours to complete (committing 50K records), whereas usually it
> finishes in 20 seconds. After further investigation it turns out the
> system was doing lot of paging - the file system buffer was trying to
> write back the big segment back to disk. I got 20G memory on system
> with 6 G assigned to Solr instance (running 2 instances).
> 
> It seems if I can control the segment size to max of 4-5 GB I'll be
> ok. Is there any way to do so?
> 
> I got merging factor of 100 - does that impacts the size too? Why
> different segments have different size?
> 
> Thanks,
> -vivek


Mime
View raw message