lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Abdul Chaudhry (JIRA)" <>
Subject [jira] Created: (LUCENE-443) ConjunctionScorer tune-up
Date Sun, 02 Oct 2005 05:25:47 GMT
ConjunctionScorer tune-up

         Key: LUCENE-443
     Project: Lucene - Java
        Type: Bug
  Components: Search  
    Versions: 1.9    
 Environment: Linux, Java 1.5, Large Index with 4 million items and some heavily nested boolean
    Reporter: Abdul Chaudhry

I just recently ran a load test on the latest code from lucene , which is using a new BooleanScore
and noticed the ConjunctionScorer was crunching through objects , especially while sorting
as part of the skipTo call. It turns a linked list into an array, sorts the array, then converts
the array back to a linked list for further processing by the scoring engines below.

'm not sure if anyone else is experiencing this as I have a very large index (> 4 million
items) and I am issuing some heavily nested queries

Anyway, I decide to change the link list into an array and use a first and last marker to
"simulate" a linked list.

This scaled much better during my load test as the java gargbage collector was less - umm
- virulent 

This message is automatically generated by JIRA.
If you think it was sent incorrectly contact one of the administrators:
For more information on JIRA, see:

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message