Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: java-user@lucene.apache.org
Received-SPF: pass (asf.osuosl.org: local policy)
Message-ID: <44980BAB.4030507@i-hypergrid.com>
Date: Tue, 20 Jun 2006 17:52:27 +0300
From: Volodymyr Bychkoviak <vbychkoviak@i-hypergrid.com>
User-Agent: Thunderbird 1.5.0.4 (Windows/20060516)
MIME-Version: 1.0
To: java-user@lucene.apache.org
Subject: Re: addIndexes() is taking infinite time ...
References: <a36516400606200507h2c381597j6d847137a4c3757@mail.gmail.com>
In-Reply-To: <a36516400606200507h2c381597j6d847137a4c3757@mail.gmail.com>
Content-Type: multipart/alternative;
 boundary="------------080507000008050602040204"

--------------080507000008050602040204
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit

I guess that you're adding those indexes one by one..
You should add all indexes at once rather then adding them one by one.
addIndexes() method takes array of directories/readers to add indexes.

IndexWriter performs optimize() after adding indexes, so with your  big 
index it can take long enough time.


heritrix.lucene wrote:
> Hi all,
> I had five different indexes:
> 1 having 15469008 documents
> 2 having 7734504 documents
> 3 having 7734504 documents
> 4 having 7734504 documents
> 5 having 7734504 documents
> Which sums to 46407024.
> The constant values are
> maxMergeFactor = 1000
> maxBufferedDocs = 1000
>
> I wrote a simple program which uses the addIndex method for adding 
> indexes.
> It has been more then 32 hours adding the indexes. My logs say upto 
> now it
> has finished only first two indexes. It is adding the third one.
> I want to know what exactly happens while merging the indexes?? Why this
> time grows exponentially ????
> Can anybody explain this in brief.
>
> Thanks in advance..
> With Regards
>

-- 
regards,
Volodymyr Bychkoviak


--------------080507000008050602040204--