Return-Path: Delivered-To: apmail-lucene-general-archive@www.apache.org Received: (qmail 89285 invoked from network); 29 Aug 2010 08:06:40 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 29 Aug 2010 08:06:40 -0000 Received: (qmail 28211 invoked by uid 500); 29 Aug 2010 08:06:40 -0000 Delivered-To: apmail-lucene-general-archive@lucene.apache.org Received: (qmail 27784 invoked by uid 500); 29 Aug 2010 08:06:37 -0000 Mailing-List: contact general-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: general@lucene.apache.org Delivered-To: mailing list general@lucene.apache.org Received: (qmail 27776 invoked by uid 99); 29 Aug 2010 08:06:35 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 29 Aug 2010 08:06:35 +0000 X-ASF-Spam-Status: No, hits=2.9 required=10.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (nike.apache.org: local policy) Received: from [209.85.214.176] (HELO mail-iw0-f176.google.com) (209.85.214.176) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 29 Aug 2010 08:06:28 +0000 Received: by iwn9 with SMTP id 9so5197827iwn.35 for ; Sun, 29 Aug 2010 01:06:06 -0700 (PDT) MIME-Version: 1.0 Received: by 10.231.173.9 with SMTP id n9mr3302562ibz.146.1283069166541; Sun, 29 Aug 2010 01:06:06 -0700 (PDT) Received: by 10.231.139.202 with HTTP; Sun, 29 Aug 2010 01:06:06 -0700 (PDT) In-Reply-To: References: Date: Sun, 29 Aug 2010 11:06:06 +0300 Message-ID: Subject: Re: Performance Optimizations and Expected Benchmark Results From: Ron Ratovsky To: general@lucene.apache.org Content-Type: multipart/alternative; boundary=0016364ec7aee4db6a048ef1d109 X-Virus-Checked: Checked by ClamAV on apache.org --0016364ec7aee4db6a048ef1d109 Content-Type: text/plain; charset=UTF-8 The indexing is done synchronously to saving the data. Doing it asynchronously works slower since then the data to be indexed needs to be read from the data store, which is slower. On Thu, Aug 26, 2010 at 18:58, Jenny Brown wrote: > Do you index as you go along, or do you batch your updates to the > index? Sometimes doing a large batch at once can improve total > throughput, compared with singles. > > > --0016364ec7aee4db6a048ef1d109--