Return-Path: Delivered-To: apmail-lucene-java-user-archive@www.apache.org Received: (qmail 47808 invoked from network); 9 Aug 2005 09:53:42 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (209.237.227.199) by minotaur.apache.org with SMTP; 9 Aug 2005 09:53:42 -0000 Received: (qmail 50219 invoked by uid 500); 9 Aug 2005 09:53:37 -0000 Delivered-To: apmail-lucene-java-user-archive@lucene.apache.org Received: (qmail 50198 invoked by uid 500); 9 Aug 2005 09:53:36 -0000 Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: java-user@lucene.apache.org Delivered-To: mailing list java-user@lucene.apache.org Received: (qmail 50185 invoked by uid 99); 9 Aug 2005 09:53:36 -0000 Received: from asf.osuosl.org (HELO asf.osuosl.org) (140.211.166.49) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 09 Aug 2005 02:53:36 -0700 X-ASF-Spam-Status: No, hits=0.0 required=10.0 tests= X-Spam-Check-By: apache.org Received-SPF: pass (asf.osuosl.org: local policy) Received: from [194.44.193.196] (HELO uar.i-hypergrid.com) (194.44.193.196) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 09 Aug 2005 02:53:57 -0700 Received: from [192.168.0.86] (vbychkoviak.jforce [192.168.0.86]) by uar.i-hypergrid.com (Postfix) with ESMTP id 945621C9FF for ; Tue, 9 Aug 2005 12:53:27 +0300 (EEST) Message-ID: <42F87D3C.7060004@i-hypergrid.com> Date: Tue, 09 Aug 2005 12:54:04 +0300 From: Volodymyr Bychkoviak User-Agent: Mozilla Thunderbird 1.0.2 (Windows/20050317) X-Accept-Language: en-us, en MIME-Version: 1.0 To: java-user@lucene.apache.org Subject: Re: merging indexes together References: <92A278501EF50444AD3EE1FFB51219550BCE3936@emss10m03.rck.atm.lmco.com> In-Reply-To: <92A278501EF50444AD3EE1FFB51219550BCE3936@emss10m03.rck.atm.lmco.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org X-Spam-Rating: minotaur.apache.org 1.6.2 0/1000/N Thanks. I didn't think about such simple solution:) Mordo, Aviran (EXP N-NANNATEK) wrote: >Why don't you just add the new information directly to the main index ? >As long as you don't get a new IndexReader you should be able to access >the old information. Once your indexing and deletion is done just get a >new IndexReader instance to access the new documents. > >Aviran >http://www.aviransplace.com > >-----Original Message----- >From: Volodymyr Bychkoviak [mailto:vbychkoviak@i-hypergrid.com] >Sent: Monday, August 08, 2005 1:50 PM >To: java-user@lucene.apache.org >Subject: merging indexes together > >Hello All. > >In my program I index new information to temporary dir and after then I >delete outdated information from main index and add new information by >calling indexWriter.addIndexes() method. This works fine when doc number >is relatively small but when index size grows, every call to addIndexes >can take very long. (NOTE: new information is ONLY part of all index) > >The reason I'm using this approach is that I want old information to be >available during indexing new information and then switch as fast as I >can to new information. > >current index 336Mb / 1100000 Docs. and growing... >current time to merge indexes is about 5min. > >Any ideas how to optimize this? > >-- >regards, >Volodymyr Bychkoviak > > >--------------------------------------------------------------------- >To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org >For additional commands, e-mail: java-user-help@lucene.apache.org > > > >--------------------------------------------------------------------- >To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org >For additional commands, e-mail: java-user-help@lucene.apache.org > > > > -- regards, Volodymyr Bychkoviak --------------------------------------------------------------------- To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org For additional commands, e-mail: java-user-help@lucene.apache.org