lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Otis Gospodnetic <otis.gospodne...@gmail.com>
Subject Re: massive memory consumption of grouping feature
Date Wed, 09 Jan 2013 20:09:10 GMT
Hello Class,

How is the memory consumption when you do not use grouping *at all*,
meaning you start Solr and run all your queries, but with group=false?
Maybe it's not grouping that's the (main) "problem", but simply a Solr
upgrade in general.

Otis
--
Solr & ElasticSearch Support
http://sematext.com/





On Wed, Jan 9, 2013 at 10:50 AM, clawu01 <claas.wunderlich@bertelsmann.de>wrote:

> Hello,
>
> we are upgrading solr from 1.3 to 4.0.
> In solr 1.3 we used the SOLR-236 patch to realize grouping/ field
> collapsing.
> We did not have a memory issue with the field collapsing feature in our 1.3
> version.
> However, we do now. The query looks something like this:
>
>
> http://localhost:8983/solr/select?fl=*,score&group.ngroups=true&group.limit=-1&group.field=someGroupingField&group=true&fq=someField:someValue&fq=anotherField:anotherValue&wt=xml&fq=thirdField:[0+TO+1]&rows=30000
>
> as you can see the q parameter is empty, but it does not make a difference
> if I query for q=someValue+anotherValue
>
> The result returns:
> <int name="matches">3772</int>
> <int name="ngroups">2175</int>
>
> We have a memory consumption of about 4G. What causes this massive memory
> consumption? How can it be reduced?
>
> Regards,
>
> Claas
>
>
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/massive-memory-consumption-of-grouping-feature-tp4031895.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message