Return-Path: Delivered-To: apmail-lucene-java-user-archive@www.apache.org Received: (qmail 63610 invoked from network); 8 Aug 2008 21:29:19 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 8 Aug 2008 21:29:19 -0000 Received: (qmail 55753 invoked by uid 500); 8 Aug 2008 21:29:12 -0000 Delivered-To: apmail-lucene-java-user-archive@lucene.apache.org Received: (qmail 55711 invoked by uid 500); 8 Aug 2008 21:29:11 -0000 Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: java-user@lucene.apache.org Delivered-To: mailing list java-user@lucene.apache.org Received: (qmail 55700 invoked by uid 99); 8 Aug 2008 21:29:11 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 08 Aug 2008 14:29:11 -0700 X-ASF-Spam-Status: No, hits=-0.0 required=10.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: local policy) Received: from [67.15.82.66] (HELO dz7.dailyrazor.com) (67.15.82.66) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 08 Aug 2008 21:28:15 +0000 Received: from c-76-100-33-180.hsd1.md.comcast.net ([76.100.33.180]:50080 helo=[192.168.169.1]) by dz7.dailyrazor.com with esmtpa (Exim 4.69) (envelope-from ) id 1KRZVp-0000gA-S9 for java-user@lucene.apache.org; Fri, 08 Aug 2008 16:28:42 -0500 Message-ID: <489CC880.1030503@littlebunch.com> Date: Fri, 08 Aug 2008 17:28:16 -0500 From: Gary Moore User-Agent: Thunderbird 2.0.0.16 (X11/20080707) MIME-Version: 1.0 To: java-user@lucene.apache.org Subject: 2.3.2 Indexing Performance Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-AntiAbuse: This header was added to track abuse, please include it with any abuse report X-AntiAbuse: Primary Hostname - dz7.dailyrazor.com X-AntiAbuse: Original Domain - lucene.apache.org X-AntiAbuse: Originator/Caller UID/GID - [47 12] / [47 12] X-AntiAbuse: Sender Address Domain - littlebunch.com X-Virus-Checked: Checked by ClamAV on apache.org Parsing and indexing 4.5 million MARC/XML bibliographic records was requiring ~14 hrs. using 2.2. The same job using 2.3 takes ~ 5 hrs. on the same platform -- a quad processor Sun V440 w/8GB memory. I'm using the PerFieldAnalyzerWrapper (StandardAnalyzer and SnowballAnalyzer). I'm impressed! Is this typical? Gary Moore gary@littlebunch.com --------------------------------------------------------------------- To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org For additional commands, e-mail: java-user-help@lucene.apache.org