Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 1AAE7160C15 for ; Wed, 3 Jan 2018 16:08:56 +0100 (CET) Received: (qmail 84901 invoked by uid 500); 3 Jan 2018 15:08:55 -0000 Mailing-List: contact solr-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: solr-user@lucene.apache.org Delivered-To: mailing list solr-user@lucene.apache.org Received: (qmail 84887 invoked by uid 99); 3 Jan 2018 15:08:55 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 03 Jan 2018 15:08:54 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 7503FC126D for ; Wed, 3 Jan 2018 15:08:54 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -0.121 X-Spam-Level: X-Spam-Status: No, score=-0.121 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id kI1gjnr-UrxZ for ; Wed, 3 Jan 2018 15:08:53 +0000 (UTC) Received: from mail-yw0-f182.google.com (mail-yw0-f182.google.com [209.85.161.182]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id F37815F3B5 for ; Wed, 3 Jan 2018 15:08:52 +0000 (UTC) Received: by mail-yw0-f182.google.com with SMTP id y187so634161ywd.12 for ; Wed, 03 Jan 2018 07:08:52 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-transfer-encoding; bh=CJzM2FPqAPqWRfb6DUMUP1m+33EpGBYQeDnQDDRz2m0=; b=jIEeo3OM0zvg/gl1d+UhLhW5mYrkp/zq8Tp8Re0GvpBUxadoOUZCB8yNSr8jkimPpz qCtGAh0qBzIZr/W8DvoRwGBfXdpjLfiCdrVt3UKq2+FPpFYgWIh6YdGFyWQFrrlYet/a FgfqtQdOpvOR0q9oH/ITdzK4i+OqgKBd/9A2d1U8Gn2/9MjFp1lbBBhQ2fKlILrIGcd/ OO+0D4OSqLmLnHZxu2fo9aPL427zzLRpRaUVMugVCSJPYVKJSIL9B5YoRJP28nZN8f5c MdoNA/jyOrkHGBGQSFTy464wIyJ+BqahKwZcDVs3sSfhTX72FABGr20F0QwpLSJzbir6 BErQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:content-transfer-encoding; bh=CJzM2FPqAPqWRfb6DUMUP1m+33EpGBYQeDnQDDRz2m0=; b=io411FXe75qkefiml7cp/fX5e0osFxvKc3ah+33gH9alhEiUsN4m5o1K5GIuZ0Nmo4 GAnPoYb4E3QArIL07TOK2uIDxAUXnjrBYJak0EEvAcc1mmFu99HOrOjT20rohBd+bbnv xKAfAUP44X4RylazSxRL6MZ6Le8JIVOBnwLckmlsx/GNRh0ZVSCncXCoQPmQI3nEBIov +OWM1d23c2jehAZervepn/EXnYy3W4+L5LmLPtdIFDqtWhOtPDc0xLwK5WEAKNhRKGi0 7OjJ04eDmRr8Al/CYSzJpMyaCyP7GaibugOv+tfUQJGrCu5IH/bhd/i8VXmPHUw0BbxK 8HHg== X-Gm-Message-State: AKGB3mL/ede0Ptkojb6gJ+JQJfBVggWPzHvdROYaVKNSUid9cKvrUoF1 OClmoxZ/iKERgZGMIvWRkzZsDusrxysRjy5GsUBA42gD X-Google-Smtp-Source: ACJfBosJ0Q7sFKJUWZq8tuGzCA+AELCHH4caQ0eu84iPqowvqc12FUG5WJTEGMO6VT6dzi5/6/apl+2c9nUciEeZXd0= X-Received: by 10.129.94.212 with SMTP id s203mr1595737ywb.123.1514992132352; Wed, 03 Jan 2018 07:08:52 -0800 (PST) MIME-Version: 1.0 Received: by 10.13.213.212 with HTTP; Wed, 3 Jan 2018 07:08:11 -0800 (PST) In-Reply-To: References: From: Alexandre Rafalovitch Date: Wed, 3 Jan 2018 10:08:11 -0500 Message-ID: Subject: Re: Heavy operations in PostFilter are heavy To: solr-user , Solrmails Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable archived-at: Wed, 03 Jan 2018 15:08:57 -0000 Are you doing cache=3Dfalse and cost > 100? See the recent article on the topic deep-dive, if you haven't: https://lucidworks.com/2017/11/27/caching-and-filters-and-post-filters/ Regards, Alex. On 3 January 2018 at 05:31, Solrmails wrote: > Hello, > > I tried to write a Solr PostFilter to do filtering within the 'collect'-M= ethod(DelegatingCollector). I have to do some heavy operations within the '= collect'-Method. This isn't a problem for a few results. But unfortunately = it taks forever with 50 or more results. This is because I have to do the c= hecks for every single id again and can't process a list of ids within 'col= lect'. > > Is there a better place to do PostFiltering? But I don't want to reimplem= ent the Solr Paging/Coursor-Feature to get my things to work. > > Thank You