Mailing-List: contact user-help@lucy.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@lucy.apache.org
Received-SPF: neutral (athena.apache.org: local policy)
MIME-Version: 1.0
In-Reply-To: <WC20130301142633.37002A@delos.nl>
References: <WC20130301142633.37002A@delos.nl>
Date: Mon, 4 Mar 2013 06:17:29 -0800
Message-ID: 
 <CAAS6=7iEbc6xCcf9pMiHWYtrgu9JRPERRq5TLCaZ5wUD6RZTUA@mail.gmail.com>
From: Marvin Humphrey <marvin@rectangular.com>
To: user@lucy.apache.org
Content-Type: text/plain; charset=ISO-8859-1
Subject: Re: [lucy-user] input 47 too high

On Fri, Mar 1, 2013 at 6:26 AM, Thomas den Braber <thomas@delos.nl> wrote:
> I have a problem when adding a lot of records to the index. After about 1000
> records I get this error: input 47 too high.

This is a bug, which the following patch should address:

--- a/core/Lucy/Index/IndexManager.c
+++ b/core/Lucy/Index/IndexManager.c
@@ -122,7 +122,7 @@ static uint32_t
 S_fibonacci(uint32_t n) {
     uint32_t result = 0;
     if (n > 46) {
-        THROW(ERR, "input %u32 too high", n);
+        return UINT32_MAX;
     }
     else if (n < 2) {
         result = n;

> I do a commit every 20 records instead of after every record to increase the
> performance.  Is this a good idea? or must I do a commit after every record
> added

In general, you should batch up docs together, as that will result in less
file churn and make indexing more efficient.  The only reason to commit more
frequently is to make data available to searches sooner and meet
application-specific requirements for responsiveness during near-real-time
updates.

Marvin Humphrey