Mailing-List: contact user-help@lucy.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@lucy.apache.org
Received-SPF: pass (athena.apache.org: local policy includes SPF record at
 spf.trusted-forwarder.org)
Content-Type: text/plain; charset=windows-1252
Mime-Version: 1.0 (Mac OS X Mail 7.1 \(1827\))
From: Nick Wellnhofer <wellnhofer@aevum.de>
In-Reply-To: <1391206680662-4114766.post@n3.nabble.com>
Date: Sat, 1 Feb 2014 01:33:14 +0100
Content-Transfer-Encoding: quoted-printable
Message-Id: <46156520-BAD9-45D6-A43D-D40D207EAA10@aevum.de>
References: <1390937188978-4114036.post@n3.nabble.com>
 <CAAS6=7hCE6KMGFSVSgWC2qKMyxB2EFNy2kbUX-ryM9VNUSqVKg@mail.gmail.com>
 <6BDF528D-50AE-4EF3-978B-D7A45832E562@aevum.de>
 <1391201004104-4114751.post@n3.nabble.com>
 <D6F00EBA-DAB9-4F26-9E86-953BD732877C@aevum.de>
 <1391206680662-4114766.post@n3.nabble.com>
To: user@lucy.apache.org
Subject: Re: [lucy-user] 32 bit CentOS Indexing Question

On Jan 31, 2014, at 23:18 , Nick D. <ndwyer@globaldataguard.com> wrote:

> Does the Lucy::Index::SortWriter::set_default_mem_thresh($bytes); =
function
> exist in the latest public 0.3.3 version of lucy?

Yes, but it=92s ineffective due to a bug which the sortfieldwriter =
branch should fix.

> Is there a function like this for SegWriter (I'm assuming this is used =
for
> writing segments that are not sortable)? if so what is the default?

Yes, there=92s

    Lucy::Index::PostingListWriter::set_default_mem_thresh($bytes);

with a default of 16MB. This affects segment merging for indexed fields.

(A segment contains data for all the fields of your schema. =
PostingListWriter creates the posting lists for indexed fields. =
SortWriter creates the sort cache for sortable fields. Both posting =
lists and sort caches are contained in a segment.)

> Are there any downsides to increasing this threshold to say 40MB?

No, if you have enough memory, you can probably use a much higher value. =
Maybe Marvin can give some additional details.

Nick