Return-Path: Delivered-To: apmail-lucene-java-user-archive@www.apache.org Received: (qmail 23083 invoked from network); 13 Jan 2010 11:21:43 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 13 Jan 2010 11:21:43 -0000 Received: (qmail 73854 invoked by uid 500); 13 Jan 2010 11:21:41 -0000 Delivered-To: apmail-lucene-java-user-archive@lucene.apache.org Received: (qmail 73784 invoked by uid 500); 13 Jan 2010 11:21:41 -0000 Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: java-user@lucene.apache.org Delivered-To: mailing list java-user@lucene.apache.org Received: (qmail 73774 invoked by uid 99); 13 Jan 2010 11:21:41 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 13 Jan 2010 11:21:41 +0000 X-ASF-Spam-Status: No, hits=1.2 required=10.0 tests=SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (nike.apache.org: local policy) Received: from [209.85.217.215] (HELO mail-gx0-f215.google.com) (209.85.217.215) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 13 Jan 2010 11:21:33 +0000 Received: by gxk7 with SMTP id 7so21846206gxk.12 for ; Wed, 13 Jan 2010 03:21:11 -0800 (PST) MIME-Version: 1.0 Received: by 10.151.17.2 with SMTP id u2mr597929ybi.110.1263381671426; Wed, 13 Jan 2010 03:21:11 -0800 (PST) In-Reply-To: <27097887.post@talk.nabble.com> References: <27056573.post@talk.nabble.com> <27058014.post@talk.nabble.com> <9ac0c6aa1001070332m604ec9case3ea753633bdd0db@mail.gmail.com> <27062291.post@talk.nabble.com> <9ac0c6aa1001070902y5cb8780coa4ed38f86403bc04@mail.gmail.com> <27092361.post@talk.nabble.com> <9ac0c6aa1001100346u36f1a69at48200b9fdd2da65d@mail.gmail.com> <27097693.post@talk.nabble.com> <9ac0c6aa1001100410v7f471708t515bc0fad0bec12b@mail.gmail.com> <27097887.post@talk.nabble.com> Date: Wed, 13 Jan 2010 06:21:11 -0500 Message-ID: <9ac0c6aa1001130321u5f818e49u6415862dbb259e37@mail.gmail.com> Subject: Re: Is there a way to limit the size of an index? From: Michael McCandless To: java-user@lucene.apache.org Content-Type: text/plain; charset=ISO-8859-1 X-Virus-Checked: Checked by ClamAV on apache.org On Sun, Jan 10, 2010 at 7:33 AM, Dvora wrote: > > I'm storing and reading the documents using Compass, not Lucene directly. I > didn't touch those parameters, so I guess the default values are being used > (I do see cfs files in the index). OK. If your index directory has *.cfs files, then you are using the default compound file format (I'm not sure whether Compass changes that default either). > How the ramBufferSizeMB parameter affect the files size? What value should I > use in order to have 6MB files? ramBufferSizeMB controls how big the initially created segments are. Just how big a segment you get for a given ramBufferMB is very app dependent, because the RAM efficiency of IndexWriter depends on things like whether you have many unique terms (= worse RAM efficiency). Generally larger RAM buffers have better efficiency. Merging can only create bigger segments from those flushed segments. So, you have to ensure ramBufferSizeMB is set such that in your use case it never up and flushes a segment bigger than your 10 MB size limit. Mike --------------------------------------------------------------------- To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org For additional commands, e-mail: java-user-help@lucene.apache.org