Mailing-List: contact solr-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: solr-user@lucene.apache.org
Received-SPF: pass (athena.apache.org: domain of otis.gospodnetic@gmail.com
 designates 209.85.214.176 as permitted sender)
MIME-Version: 1.0
In-Reply-To: <1357746645135-4031895.post@n3.nabble.com>
References: <1357746645135-4031895.post@n3.nabble.com>
Date: Wed, 9 Jan 2013 15:09:10 -0500
Message-ID: 
 <CANNBgPKvASX=33e-9NXa4_fwZHAZ_wsLnYqyEzuhYVALKquPRQ@mail.gmail.com>
Subject: Re: massive memory consumption of grouping feature
From: Otis Gospodnetic <otis.gospodnetic@gmail.com>
To: solr-user@lucene.apache.org
Content-Type: multipart/alternative; boundary=bcaec54d4028acac1e04d2e0a208

--bcaec54d4028acac1e04d2e0a208
Content-Type: text/plain; charset=ISO-8859-1

Hello Class,

How is the memory consumption when you do not use grouping *at all*,
meaning you start Solr and run all your queries, but with group=false?
Maybe it's not grouping that's the (main) "problem", but simply a Solr
upgrade in general.

Otis
--
Solr & ElasticSearch Support
http://sematext.com/


On Wed, Jan 9, 2013 at 10:50 AM, clawu01 <claas.wunderlich@bertelsmann.de>wrote:

> Hello,
>
> we are upgrading solr from 1.3 to 4.0.
> In solr 1.3 we used the SOLR-236 patch to realize grouping/ field
> collapsing.
> We did not have a memory issue with the field collapsing feature in our 1.3
> version.
> However, we do now. The query looks something like this:
>
>
> http://localhost:8983/solr/select?fl=*,score&group.ngroups=true&group.limit=-1&group.field=someGroupingField&group=true&fq=someField:someValue&fq=anotherField:anotherValue&wt=xml&fq=thirdField:[0+TO+1]&rows=30000
>
> as you can see the q parameter is empty, but it does not make a difference
> if I query for q=someValue+anotherValue
>
> The result returns:
> <int name="matches">3772</int>
> <int name="ngroups">2175</int>
>
> We have a memory consumption of about 4G. What causes this massive memory
> consumption? How can it be reduced?
>
> Regards,
>
> Claas
>
>
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/massive-memory-consumption-of-grouping-feature-tp4031895.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>

--bcaec54d4028acac1e04d2e0a208--