lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Michael Busch (JIRA)" <j...@apache.org>
Subject [jira] Commented: (LUCENE-743) IndexReader.reopen()
Date Wed, 01 Aug 2007 21:47:52 GMT

    [ https://issues.apache.org/jira/browse/LUCENE-743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12517087
] 

Michael Busch commented on LUCENE-743:
--------------------------------------

I ran some quick performance tests with this patch:

1) The test opens an IndexReader, deletes one document by random docid, closes the Reader.
   So this reader doesn't have to open the dictionary or the norms.
2) Another reader is opened (or alternatively reopened) and one TermQuery is executed, so

   this reader has to read the norms and the dictionary. 

I run these two steps 5000 times in a loop.
   
First run: Index size: 4.5M, optimized 
   
   * 1) + TermQuery:    103 sec
   * 1) + 2) (open):    806 sec, so open()   takes 703 sec
   * 1) + 2) (reopen):  118 sec, so reopen() takes  15 sec ==> Speedup: 46.9 X
   

Second run: Index size: 3.3M, 24 segments (14x 230.000, 10x 10.000)

   * 1) + TermQuery:    235 sec
   * 1) + 2) (open):   1162 sec, so open()   takes 927 sec
   * 1) + 2) (reopen):  321 sec, so reopen() takes  86 sec ==> Speedup: 10.8X

> IndexReader.reopen()
> --------------------
>
>                 Key: LUCENE-743
>                 URL: https://issues.apache.org/jira/browse/LUCENE-743
>             Project: Lucene - Java
>          Issue Type: Improvement
>          Components: Index
>            Reporter: Otis Gospodnetic
>            Assignee: Michael Busch
>            Priority: Minor
>             Fix For: 2.3
>
>         Attachments: IndexReaderUtils.java, lucene-743.patch, lucene-743.patch, lucene-743.patch,
MyMultiReader.java, MySegmentReader.java
>
>
> This is Robert Engels' implementation of IndexReader.reopen() functionality, as a set
of 3 new classes (this was easier for him to implement, but should probably be folded into
the core, if this looks good).

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


Mime
View raw message