Return-Path: Delivered-To: apmail-lucene-java-user-archive@www.apache.org Received: (qmail 40827 invoked from network); 16 Jun 2005 14:36:45 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (209.237.227.199) by minotaur.apache.org with SMTP; 16 Jun 2005 14:36:45 -0000 Received: (qmail 66772 invoked by uid 500); 16 Jun 2005 14:36:39 -0000 Delivered-To: apmail-lucene-java-user-archive@lucene.apache.org Received: (qmail 66730 invoked by uid 500); 16 Jun 2005 14:36:38 -0000 Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: java-user@lucene.apache.org Delivered-To: mailing list java-user@lucene.apache.org Received: (qmail 66681 invoked by uid 99); 16 Jun 2005 14:36:38 -0000 X-ASF-Spam-Status: No, hits=0.1 required=10.0 tests=FORGED_RCVD_HELO X-Spam-Check-By: apache.org Received-SPF: pass (hermes.apache.org: local policy) Received: from uar.spline-software.com (HELO uar.i-hypergrid.com) (194.44.193.196) by apache.org (qpsmtpd/0.28) with ESMTP; Thu, 16 Jun 2005 07:36:38 -0700 Received: from [192.168.0.86] (vbychkoviak.jforce [192.168.0.86]) by uar.i-hypergrid.com (Postfix) with ESMTP id 2871B217A8 for ; Thu, 16 Jun 2005 17:36:19 +0300 (EEST) Message-ID: <42B18E62.7030100@i-hypergrid.com> Date: Thu, 16 Jun 2005 17:36:18 +0300 From: Volodymyr Bychkoviak User-Agent: Mozilla Thunderbird 0.9 (Windows/20041103) X-Accept-Language: en-us, en MIME-Version: 1.0 To: java-user@lucene.apache.org Subject: Re: Performance with multi index References: <6f3b2429050616010878ce73e1@mail.gmail.com> <41850F94-FC92-4270-BBAB-6998673CA7FC@ehatchersolutions.com> <6f3b242905061607296b6f181a@mail.gmail.com> In-Reply-To: <6f3b242905061607296b6f181a@mail.gmail.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked X-Spam-Rating: minotaur.apache.org 1.6.2 0/1000/N JM Tinghir wrote: >>Could you qualify a bit more about what is slow? >> >> > >Well, it just took 145 minutes to index 2670 files (450 MB) in one >index (29 MB). >It only took 33 minutes when I did it into ~10 indexes (global size of 32 MB). > > > > I think it took so much time, because it's merged too ofter. try to increase IndexWriter.mergeFactor (but be aware of TooManyOpenFiles Exception when setting too high) (default 10) and try to increase IndexWriter.minMergeDocs (consume more ram, but works faster). (default 10) playing a bit with this parameters you can speed up your indexing process. >>Perhaps you need to optimize the index? >> >> > >Perhaps, never tried it... > >JM > >--------------------------------------------------------------------- >To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org >For additional commands, e-mail: java-user-help@lucene.apache.org > > regards, Volodymyr Bychkoviak --------------------------------------------------------------------- To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org For additional commands, e-mail: java-user-help@lucene.apache.org