lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Anria B." <anria_o...@yahoo.com>
Subject &fq degrades qtime in a 20million doc collection
Date Wed, 13 Jan 2016 22:01:48 GMT
hi all, 

I have a Really fun question to ask.  I'm sitting here looking at what is by
far the beefiest box I've ever seen in my life.  256GB of RAM,  extreme
TerraBytes of disc space, the works.  Linux server properly partitioned 

Yet, what we are seeing goes against all intuition I've built up in the Solr
world

1.   Collection has 20-30 million docs.
2.   q=*&fq=someField:SomeVal   ---> takes 2.5 seconds
3.    q=someField:SomeVal     -->  300ms
4.   as numFound -> infinity,     qtime -> infinity.

have any of you encountered such a thing?

that FQ degrades query time by so much?   

it's pure Solr 5.3.1.   ZK + Tomcat 8 + 1shard in solr.  JDK_8u60  All
running on this same box.

We have already tested different autoCommit strategies, and different values
for heap size, starting at 16GB, 32GB, 64GB, 128GB ...    The only place we
saw a 100ms improvement was between 32 - -Xmx=64GB.  

Thanks 
Anria 



--
View this message in context: http://lucene.472066.n3.nabble.com/fq-degrades-qtime-in-a-20million-doc-collection-tp4250567.html
Sent from the Solr - User mailing list archive at Nabble.com.

Mime
View raw message