lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Markus Jelsma <markus.jel...@openindex.io>
Subject Calculating memory consumption FVH
Date Sat, 11 Jun 2011 23:27:18 GMT
Hi,

How can i calculate the memory requirements for highlighting documents where 
the variables are number of documents to highlight and the total size of the 
documents in a single request? I can then multiply a worst-case result set 
with the expected concurrency.

For example, with a _limited_ heap highlighting works perfectly well and is 
only CPU-bound, which is clearly visible when highlighting a result set with 
many very large documents. When such a worst-case query is fired a lot of times 
concurrently Solr is guaranteed to run out of memory.

So, now i'm looking for a method to calcualte per-request memory consumption 
for set-ups with FVH and all term* settings enabled on the highlighted field in 
schema.

Thanks,

Mime
View raw message