lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Abdul Chaudhry (JIRA)" <>
Subject [jira] Commented: (LUCENE-443) ConjunctionScorer tune-up
Date Mon, 03 Oct 2005 22:41:48 GMT
    [ ] 

Abdul Chaudhry commented on LUCENE-443:

Thanks Paul,  re-ran load tests here, everything looks good and it looks easier to read as
I also checked Arrays.sort, it's a merge sort - guaranteed nlogn.
This all looks squeaky clean.
-- Abdul

> ConjunctionScorer tune-up
> -------------------------
>          Key: LUCENE-443
>          URL:
>      Project: Lucene - Java
>         Type: Bug
>   Components: Search
>     Versions: 1.9
>  Environment: Linux, Java 1.5, Large Index with 4 million items and some heavily nested
boolean queries
>     Reporter: Abdul Chaudhry
>  Attachments:,
> I just recently ran a load test on the latest code from lucene , which is using a new
BooleanScore and noticed the ConjunctionScorer was crunching through objects , especially
while sorting as part of the skipTo call. It turns a linked list into an array, sorts the
array, then converts the array back to a linked list for further processing by the scoring
engines below.
> 'm not sure if anyone else is experiencing this as I have a very large index (> 4
million items) and I am issuing some heavily nested queries
> Anyway, I decide to change the link list into an array and use a first and last marker
to "simulate" a linked list.
> This scaled much better during my load test as the java gargbage collector was less -
umm - virulent 

This message is automatically generated by JIRA.
If you think it was sent incorrectly contact one of the administrators:
For more information on JIRA, see:

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message