lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Paul Elschot (JIRA)" <j...@apache.org>
Subject [jira] Updated: (LUCENE-443) ConjunctionScorer tune-up
Date Thu, 21 Sep 2006 07:17:25 GMT
     [ http://issues.apache.org/jira/browse/LUCENE-443?page=all ]

Paul Elschot updated LUCENE-443:
--------------------------------

    Attachment: Conjunction20060921.patch

Iirc the orginal performance problem was caused by creation of objects in the tight loop
doing skipTo() on al  the scorers.

This patch is against current trunk and based on the earlier posted versions of ConjunctionScorer.
which was based (by the first poster) on an existing ConjunctionScorer with an ASL notice,
which is why I could grant the licence to ASF.

> ConjunctionScorer tune-up
> -------------------------
>
>                 Key: LUCENE-443
>                 URL: http://issues.apache.org/jira/browse/LUCENE-443
>             Project: Lucene - Java
>          Issue Type: Bug
>          Components: Search
>    Affects Versions: 1.9
>         Environment: Linux, Java 1.5, Large Index with 4 million items and some heavily
nested boolean queries
>            Reporter: Abdul Chaudhry
>         Attachments: Conjunction20060921.patch, ConjunctionScorer.java, ConjunctionScorer.java
>
>
> I just recently ran a load test on the latest code from lucene , which is using a new
BooleanScore and noticed the ConjunctionScorer was crunching through objects , especially
while sorting as part of the skipTo call. It turns a linked list into an array, sorts the
array, then converts the array back to a linked list for further processing by the scoring
engines below.
> 'm not sure if anyone else is experiencing this as I have a very large index (> 4
million items) and I am issuing some heavily nested queries
> Anyway, I decide to change the link list into an array and use a first and last marker
to "simulate" a linked list.
> This scaled much better during my load test as the java gargbage collector was less -
umm - virulent 

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


Mime
View raw message