lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bryant, Michael" <michael.bry...@kcl.ac.uk>
Subject RE: Simulating group.facet for JSON facets, high mem usage w/ sorting on aggregation...
Date Mon, 13 Feb 2017 08:21:29 GMT
Thanks for letting me know Yonik, I'll watch this issue with interest.

BTW, I said Solr 4.6.1 in my original post - that should've been 6.4.1.

Cheers,
~Mike
________________________________________
From: Yonik Seeley [yseeley@gmail.com]
Sent: 10 February 2017 21:44
To: solr-user@lucene.apache.org
Subject: Re: Simulating group.facet for JSON facets, high mem usage w/ sorting on aggregation...

FYI, I just opened https://emea01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fissues.apache.org%2Fjira%2Fbrowse%2FSOLR-10122&data=01%7C01%7Cmichael.bryant%40kcl.ac.uk%7C0c5a8ff25fe5427a978c08d451fe0df9%7C8370cf1416f34c16b83c724071654356%7C0&sdata=jfzd2uMZr5DPOy6FeFMZuV4P3%2B4l1ImhQjjl9i0hvOA%3D&reserved=0
for this
-Yonik

On Fri, Feb 10, 2017 at 4:32 PM, Yonik Seeley <yseeley@gmail.com> wrote:
> On Thu, Feb 9, 2017 at 6:58 AM, Bryant, Michael
> <michael.bryant@kcl.ac.uk> wrote:
>> Hi all,
>>
>> I'm converting my legacy facets to JSON facets and am seeing much better performance,
especially with high cardinality facet fields. However, the one issue I can't seem to resolve
is excessive memory usage (and OOM errors) when trying to simulate the effect of "group.facet"
to sort facets according to a grouping field.
>
> Yeah, I sort of expected this... but haven't gotten around to
> implementing something that takes less memory yet.
> If you're faceting on A and sorting by unique(B), then memory use is
> O(cardinality(A)*cardinality(B))
> We can definitely do a lot better.
>
> -Yonik

Mime
View raw message