lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Michael McCandless (JIRA)" <j...@apache.org>
Subject [jira] Commented: (LUCENE-2694) MTQ rewrite + weight/scorer init should be single pass
Date Tue, 21 Dec 2010 11:47:00 GMT

    [ https://issues.apache.org/jira/browse/LUCENE-2694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12973592#action_12973592
] 

Michael McCandless commented on LUCENE-2694:
--------------------------------------------

OK I tested perf on 10 M wiki index, multi-segment no deletes.  For the test I [unnaturally]
forced Prefix & Wildcard queries to always use scoring BQ rewrite (and upped the BQ max
clause count way high) to force testing of TermState.

||Query||QPS mmap||QPS mmap||Pct diff||||
|"unit state"~3|5.29|4.96|{color:red}-6.3%{color}|
|unit state|11.70|11.21|{color:red}-4.2%{color}|
|"unit state"|7.80|7.71|{color:red}-1.2%{color}|
|spanNear([unit, state], 10, true)|4.58|4.53|{color:red}-1.1%{color}|
|state|29.42|29.39|{color:red}-0.1%{color}|
|unit~2.0|9.90|9.91|{color:green}0.2%{color}|
|doctimesecnum:[10000 TO 60000]|9.52|9.55|{color:green}0.3%{color}|
|+unit +state|11.04|11.09|{color:green}0.4%{color}|
|unit~1.0|10.11|10.19|{color:green}0.7%{color}|
|united~2.0|3.34|3.36|{color:green}0.8%{color}|
|spanFirst(unit, 5)|16.71|16.93|{color:green}1.3%{color}|
|+nebraska +state|195.03|198.25|{color:green}1.7%{color}|
|united~1.0|15.78|16.11|{color:green}2.1%{color}|
|un*d|12.59|29.45|{color:green}133.9%{color}|
|unit*|6.87|16.54|{color:green}140.7%{color}|
|u*d|2.39|6.66|{color:green}178.2%{color}|
|uni*|1.82|5.29|{color:green}190.6%{color}|

Awesome speedups!

> MTQ rewrite + weight/scorer init should be single pass
> ------------------------------------------------------
>
>                 Key: LUCENE-2694
>                 URL: https://issues.apache.org/jira/browse/LUCENE-2694
>             Project: Lucene - Java
>          Issue Type: Improvement
>          Components: Search
>            Reporter: Michael McCandless
>            Assignee: Michael McCandless
>             Fix For: 4.0
>
>         Attachments: LUCENE-2694-FTE.patch, LUCENE-2694.patch, LUCENE-2694.patch, LUCENE-2694.patch,
LUCENE-2694.patch, LUCENE-2694.patch
>
>
> Spinoff of LUCENE-2690 (see the hacked patch on that issue)...
> Once we fix MTQ rewrite to be per-segment, we should take it further and make weight/scorer
init also run in the same single pass as rewrite.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message