lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Toke Eskildsen ...@statsbiblioteket.dk>
Subject RE: A question on performance
Date Wed, 07 Jan 2015 16:22:10 GMT
rama44ster [rama44ster@gmail.com] wrote:

[3 MUST clauses]

> 50 = 16 ms
> 75 = 52 ms
> 90 = 121 ms
> 95 = 262 ms
> 99 = 76010 ms
> 99.9 = 76037 ms

> Is the latency expected to degrade when the number of docs is as high as
> 480M?

Try plotting response times as a function of hit count. My guess is that your 99 and 99.9
percentiles are for really high hitcounts, which will take a long time as they all needs to
be scored. Alternatively, if it is easier for you, just check the queries in the 99+ percentiles
manually and see if they hit a lot of documents.

If your response times grows about linear (with a bump at one point, due to switch from sparse
to non-sparse docset) as a function of hitcount, there is not much about it besides sharding,
with the current single-threaded processing of lucene queries.

- Toke Eskildsen

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


Mime
View raw message