Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id ED404200BD8 for ; Wed, 7 Dec 2016 12:40:16 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id EBDF0160B0A; Wed, 7 Dec 2016 11:40:16 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 41C47160AFD for ; Wed, 7 Dec 2016 12:40:16 +0100 (CET) Received: (qmail 99286 invoked by uid 500); 7 Dec 2016 11:40:15 -0000 Mailing-List: contact user-help@lucy.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@lucy.apache.org Delivered-To: mailing list user@lucy.apache.org Received: (qmail 99275 invoked by uid 99); 7 Dec 2016 11:40:15 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 07 Dec 2016 11:40:15 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id C3CE518397F for ; Wed, 7 Dec 2016 11:40:14 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -1.999 X-Spam-Level: X-Spam-Status: No, score=-1.999 tagged_above=-999 required=6.31 tests=[KAM_LAZY_DOMAIN_SECURITY=1, RP_MATCHES_RCVD=-2.999] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id mTiixYqAtP5b for ; Wed, 7 Dec 2016 11:40:10 +0000 (UTC) Received: from hosting04.aevum.de (hosting04.aevum.de [188.68.58.30]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id B34B35FC50 for ; Wed, 7 Dec 2016 11:40:10 +0000 (UTC) Received: from [192.168.178.20] (aftr-185-17-205-229.dynamic.mnet-online.de [185.17.205.229]) by hosting04.aevum.de (Postfix) with ESMTPSA id 87CF16004F for ; Wed, 7 Dec 2016 12:40:02 +0100 (CET) To: user@lucy.apache.org References: From: Nick Wellnhofer Message-ID: Date: Wed, 7 Dec 2016 12:40:03 +0100 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.5.1 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit Subject: Re: [lucy-user] RE: LUCY_Folder_Open_Out_IMP at core/Lucy/Store/Folder.c line 119 archived-at: Wed, 07 Dec 2016 11:40:17 -0000 On 06/12/2016 22:16, Gupta, Rajiv wrote: > I thought since I'm doing read and write together I may be getting file error so I tried to use FastUpdate method described here - http://lucy.apache.org/docs/perl/Lucy/Docs/Cookbook/FastUpdates.html You shouldn't get any filesystem errors when searching and indexing simultaneously. The only error you might get under normal operation is lock timeouts. In this case, you should consider fast updates. But the errors you're seeing indicate a different problem that probably won't be cured by fast updates. > But now I'm more frequently getting below error. > Error input 57 too high > 20161206 150630 [] S_fibonacci at core/Lucy/Index/IndexManager.c line 129 This is caused by a known bug. Unfortunately, the fix wasn't committed when it came up for the first time: https://lists.apache.org/thread.html/0465759f6eae2108be30c70b490d0f94ab2b5c66bfac2b32c76eb41f@1362406649@%3Cuser.lucy.apache.org%3E I'll make sure that the fix gets into the next release. > How many docs I should limit to commit together? If you're (re)indexing thousands of documents and don't want searchers to be locked out, you should consider indexing batches of documents and sleep between each batch to allow concurrent searches. I'd start with several hundred documents per batch and and sleep for maybe 2 seconds. This thread contains more details: https://lists.apache.org/thread.html/0adbe8d0b5dd6c7491a8f28008428a39f485fae58ed606475f94c636@1355773975@%3Cuser.lucy.apache.org%3E Nick