lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tim Smith (JIRA)" <j...@apache.org>
Subject [jira] Commented: (LUCENE-2086) When resolving deletes, IW should resolve in term sort order
Date Mon, 23 Nov 2009 20:57:39 GMT

    [ https://issues.apache.org/jira/browse/LUCENE-2086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12781615#action_12781615
] 

Tim Smith commented on LUCENE-2086:
-----------------------------------

Got some performance numbers:

Description of test (NOTE: this is representative of actions that may occur in a running system
(not a contrived test)):
* feed 4 million operations (3/4 are deletes, 1/4 are updates (single field))
* commit
* feed 1 million updates (about 1/3 are updates, 2/3/ deletes (randomly selected))
* commit

Numbers:
|| Desc || Old || New ||
| feed 4 million | 56914ms | 15698ms |
| commit 4 million | 9072ms | 14291ms |
| total (4 million) | 65986ms | 29989ms | 
| update 1 million | 46096ms | 11340ms |
| commit 1 million | 13501ms | 9273ms | 
| total (1 million) | 59597ms | 20613ms |

This shows significant improvements with new patched data (1/3 the time for 1 million, about
1/2 the time for initial 4 million feed)

This means i'm gonna definitely need to incorporate this patch while i'm still on 3.0 (will
upgrade to 3.0 as soon as its out, then apply this fix) 
Ideally, a 3.0.1 would be forthcoming in the next month or so with this fix so i wouldn't
have to maintain this patched overlay of code






> When resolving deletes, IW should resolve in term sort order
> ------------------------------------------------------------
>
>                 Key: LUCENE-2086
>                 URL: https://issues.apache.org/jira/browse/LUCENE-2086
>             Project: Lucene - Java
>          Issue Type: Improvement
>          Components: Index
>            Reporter: Michael McCandless
>            Assignee: Michael McCandless
>             Fix For: 3.1
>
>         Attachments: LUCENE-2086.patch
>
>
> See java-dev thread "IndexWriter.updateDocument performance improvement".

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


Mime
View raw message