lucy-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Marvin Humphrey <mar...@rectangular.com>
Subject Re: [lucy-user] input 47 too high
Date Mon, 04 Mar 2013 14:17:29 GMT
On Fri, Mar 1, 2013 at 6:26 AM, Thomas den Braber <thomas@delos.nl> wrote:
> I have a problem when adding a lot of records to the index. After about 1000
> records I get this error: input 47 too high.

This is a bug, which the following patch should address:

--- a/core/Lucy/Index/IndexManager.c
+++ b/core/Lucy/Index/IndexManager.c
@@ -122,7 +122,7 @@ static uint32_t
 S_fibonacci(uint32_t n) {
     uint32_t result = 0;
     if (n > 46) {
-        THROW(ERR, "input %u32 too high", n);
+        return UINT32_MAX;
     }
     else if (n < 2) {
         result = n;

> I do a commit every 20 records instead of after every record to increase the
> performance.  Is this a good idea? or must I do a commit after every record
> added

In general, you should batch up docs together, as that will result in less
file churn and make indexing more efficient.  The only reason to commit more
frequently is to make data available to searches sooner and meet
application-specific requirements for responsiveness during near-real-time
updates.

Marvin Humphrey

Mime
View raw message