Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 2910D200C86 for ; Wed, 31 May 2017 17:43:48 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 27318160BCB; Wed, 31 May 2017 15:43:48 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 6D0F7160BBA for ; Wed, 31 May 2017 17:43:47 +0200 (CEST) Received: (qmail 98760 invoked by uid 500); 31 May 2017 15:43:45 -0000 Mailing-List: contact solr-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: solr-user@lucene.apache.org Delivered-To: mailing list solr-user@lucene.apache.org Received: (qmail 98744 invoked by uid 99); 31 May 2017 15:43:45 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 31 May 2017 15:43:45 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 22106C0591 for ; Wed, 31 May 2017 15:43:45 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 3.829 X-Spam-Level: *** X-Spam-Status: No, score=3.829 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, HTML_MESSAGE=2, KAM_LINEPADDING=1.2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RCVD_IN_SORBS_SPAM=0.5, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id swZcMBt551ba for ; Wed, 31 May 2017 15:43:43 +0000 (UTC) Received: from mail-wm0-f52.google.com (mail-wm0-f52.google.com [74.125.82.52]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id 9914F5FAFA for ; Wed, 31 May 2017 15:43:42 +0000 (UTC) Received: by mail-wm0-f52.google.com with SMTP id b84so124065107wmh.0 for ; Wed, 31 May 2017 08:43:42 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=3kf3o7pfTfzIBEj4IU+QPsx1AFUH7mlFuCoEdr7FIA0=; b=KzK70VuDJ/hLWNy52+m4b2ifQKCnGcHVx6kjs0vWOR+PM+fHjwVSNLJj6A1o10pzlp qQ7ltfArPsq6vJ5i7MEFMaNkI/f6zoBgf62B/vJym+lcTaeriagJPGp4H6muJTo5x+rz 1qPSHQdBlGhw/rcw7bAOj/ZxFqVQQ57rYgS+qrWHVZV4cSQQSAGhn5/524NSpXLeKBrV QzQLuIwfc/TN2RmksqmebnQhyjV4PyhtYi8AeQHChikuMX+1fikwJdYLiOkLI4RDcVug UFhBAgD4AEMw54XgrrIiq/8TlARQrVYiMAmn+WkikHpU3BuZLxJekvj2aSdJtKizWj1+ KCyw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=3kf3o7pfTfzIBEj4IU+QPsx1AFUH7mlFuCoEdr7FIA0=; b=WGAPRBYfQe9cCa0WExvY1NRa8DktLCl07byDZofT14TWHSUVKFc1Q2ysUheD08uDV0 75/ZqwBbx2tZIVkzTBkyGdr844rziwxqdvbSE7iUZsiBUlzRteMlXyW12eDA5K8mQr6Y FKciOsSWojF4v9k6KgkS4iobaeNauTevq4DN0m12+bUJ0X0uqtDyJks/tY0NfQLoQQhw bZBu9aa1b0kJzgkKNMuuhtxqt0FIGCf3EVXt2BVtctkvh+UzIepiuGhj6DXoQqFzQ7iB gEHU7tgrnvqkFL5x2hBzn1i+teW2NZvnP8eaKQsFKuslEt5kiR2fSv4fA4bOaHO3FaVV lcuA== X-Gm-Message-State: AODbwcClPmqYv/oJ3NS+HzqqQo1zU0M/0toEEGV58r/3GKwSrIc3Wqn9 hF39N21Zj85BG2zE9kK7g4uihHm7eYIv X-Received: by 10.80.167.163 with SMTP id i32mr22392484edc.101.1496245421556; Wed, 31 May 2017 08:43:41 -0700 (PDT) MIME-Version: 1.0 Received: by 10.80.167.227 with HTTP; Wed, 31 May 2017 08:43:41 -0700 (PDT) In-Reply-To: References: From: Susheel Kumar Date: Wed, 31 May 2017 11:43:41 -0400 Message-ID: Subject: Re: Grouping and group.facet performance disaster To: solr-user@lucene.apache.org Content-Type: multipart/alternative; boundary="94eb2c194754d94a5f0550d3c84e" archived-at: Wed, 31 May 2017 15:43:48 -0000 --94eb2c194754d94a5f0550d3c84e Content-Type: text/plain; charset="UTF-8" Did you try sub-facets ( http://yonik.com/json-facet-api/ ) if that meets your facet grouping requirements or try Collapse/Expand Results. https://cwiki.apache.org/confluence/display/solr/Collapse+and+Expand+Results Thnx On Wed, May 31, 2017 at 7:16 AM, Marek Tichy wrote: > Hi, > > I'm getting a very slow response times on grouping, especially on facet > grouping. > > Without grouping, the query takes 14ms, faceting 57ms. > > With grouping, the query time goes up to 1131ms, with facet grouping, > the faceting goes up to the unbearable 12103 ms. > > Single solr instance, 927086docs, 518.23 MB size, solr 6.4.1. > > Is this really the price of grouping ? Are there any magic > tricks/tips/techniques to improve the speed ? > The query params below. > > Many thanks for any help, much appreciated. > > Best > Marek Tichy > > > > > > > > > fq=((type:knihy) OR (type:defekty)) > fl=* > start=0 > f.ebook_formats.facet.mincount=1 > f.authorid.facet.mincount=1 > f.thematicgroupid.facet.mincount=1 > f.articleparts.facet.mincount=1 > f.type.facet.mincount=1 > f.languageid.facet.mincount=1 > f.showwindow.facet.mincount=1 > f.articletypeid_grouped.facet.mincount=1 > f.languageid.facet.limit=10 > f.ebook_formats.facet.limit=10 > f.authorid.facet.limit=10 > f.type.facet.limit=10 > f.articleparts.facet.limit=10 > f.thematicgroupid.facet.limit=10 > f.articletypeid_grouped.facet.limit=10 > f.showwindow.facet.limit=100 > version=2.2 > group.limit=30 > rows=30 > echoParams=all > sort=date desc,planneddate asc > group.field=edition > facet.method=enum > group.truncate=false > group.format=grouped > group=true > group.ngroups=true > stats=true > facet=true > group.facet=true > stats.field={!distinctValues=true}categoryid > facet.field={!ex=at}articletypeid_grouped > facet.field={!ex=at}type > facet.field={!ex=author}authorid > facet.field={!ex=format}articleparts > facet.field={!ex=format}ebook_formats > facet.field={!ex=lang}languageid > facet.field={!ex=sw}showwindow > facet.field={!ex=tema}thematicgroupid > stats.field={!min=true max=true}price > stats.field={!min=true max=true}yearout > --94eb2c194754d94a5f0550d3c84e--