lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Grant Ingersoll <gsing...@apache.org>
Subject Re: high lookup time on single lucene index
Date Sun, 03 Feb 2008 17:28:04 GMT
Have a look at http://wiki.apache.org/lucene-java/BasicsOfPerformance

Your times sound pretty high, but it depends on the complexity of the  
query, etc.  Can you share information about your queries, etc.?  Are  
you opening the IndexSearcher on every query?

-Grant

On Feb 3, 2008, at 12:24 PM, phiras wrote:

>
> Hi,
> We have a single Lucene index consist of 4.5 million document with 20
> million different term.
> The lookup time is too high , (more than 3 seconds) for a none-simple
> boolean query, this high lookup time is not acceptable.
>
> We did a simple test to figure out the relation between ( documents  
> count &
> lookup time ) and the results was amazing.
> note :  queries and documents are generated randomly
>
> Doc count  /  lookup time  for 1000 multi term query ( in  
> milliseconds )
> 5000	    /   1683
> 10000	   /   2898
> 15000	   /   23667
> 20000	   /   25002
> 25000	   /   31282
> 30000	   /   43849
> 35000	   /   53526
> 40000	   /   69321
> 45000	   /   73319
> 50000	   /   80006
>
> My questions now are :
> 1- What's the search complexity in Lucene (driven by what ?).
> 2- How can we enhance search performance ?
>
> Thank you.
>
> --------------------------------------------------
> Firas Kassem,
> d1g corp.
>
>
>
> -- 
> View this message in context: http://www.nabble.com/high-lookup-time-on-single-lucene-index-tp15255763p15255763.html
> Sent from the Lucene - Java Developer mailing list archive at  
> Nabble.com.
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-dev-help@lucene.apache.org
>

--------------------------
Grant Ingersoll
http://lucene.grantingersoll.com
http://www.lucenebootcamp.com

Lucene Helpful Hints:
http://wiki.apache.org/lucene-java/BasicsOfPerformance
http://wiki.apache.org/lucene-java/LuceneFAQ





---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


Mime
View raw message