Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 34E8B2004A0 for ; Wed, 16 Aug 2017 09:06:40 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 3369E167D0D; Wed, 16 Aug 2017 07:06:40 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 7A488167D05 for ; Wed, 16 Aug 2017 09:06:39 +0200 (CEST) Received: (qmail 3259 invoked by uid 500); 16 Aug 2017 07:06:37 -0000 Mailing-List: contact solr-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: solr-user@lucene.apache.org Delivered-To: mailing list solr-user@lucene.apache.org Received: (qmail 3247 invoked by uid 99); 16 Aug 2017 07:06:37 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 16 Aug 2017 07:06:37 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 7715218063E for ; Wed, 16 Aug 2017 07:06:36 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -2.302 X-Spam-Level: X-Spam-Status: No, score=-2.302 tagged_above=-999 required=6.31 tests=[RCVD_IN_DNSWL_MED=-2.3, RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id yda0qOjRkVAo for ; Wed, 16 Aug 2017 07:06:34 +0000 (UTC) Received: from unibi-smtp-a.hrz.uni-bielefeld.de (unibi-smtp-a.hrz.uni-bielefeld.de [129.70.208.12]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTP id 622705FCE2 for ; Wed, 16 Aug 2017 07:06:34 +0000 (UTC) MIME-version: 1.0 Content-transfer-encoding: 7BIT Content-type: text/plain; CHARSET=US-ASCII Received: from [129.70.11.68] ([129.70.11.68]) by unibi-smtp-a.hrz.uni-bielefeld.de (Oracle Communications Messaging Server 7.0.5.37.0 64bit (built Jan 25 2016)) with ESMTPPA id <0OUR0097CNQSIY30@unibi-smtp-a.hrz.uni-bielefeld.de> for solr-user@lucene.apache.org; Wed, 16 Aug 2017 09:06:28 +0200 (CEST) X-Connecting-IP: [129.70.11.68] X-PMX-Version: 6.3.3.2656215, Antispam-Engine: 2.7.2.2107409, Antispam-Data: 2017.8.16.65416, AntiVirus-Engine: 5.40.0, AntiVirus-Data: 2017.8.16.5400000, pmx11 X-EnvFrom: bernd.fehling@uni-bielefeld.de Subject: Re: QueryParser changes query by itself To: solr-user@lucene.apache.org References: <73193f1c-cbef-378e-152d-dff70461a6d9@uni-bielefeld.de> <910_1502817132_v7FHCAeg003228_1723543610.2179703.1502816843977@mail.yahoo.com> From: Bernd Fehling Message-id: <73bde89f-d0b4-e72a-e8c9-df6754c29bd7@uni-bielefeld.de> Date: Wed, 16 Aug 2017 09:06:28 +0200 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.2.1 In-reply-to: <910_1502817132_v7FHCAeg003228_1723543610.2179703.1502816843977@mail.yahoo.com> Content-language: de-DE archived-at: Wed, 16 Aug 2017 07:06:40 -0000 Hi Ahmet, thank you for your reply. I was also targeting towards QueryCache but with your hint about LUCENE-3758 I have a better point to start with. If the system is under high load and the the QueryCache is filled I have a higher rate of changed queries. In debug mode the "timing-->process-->query" of changed queries is always "0" zero. The query parser "SynonymQParser" is self developed which uses QParserPlugin. There is no caching inside and works for years. Only compiled against recent Lucene/Solr and some modifications like using Builder with newer Lucene versions. I will test without query cache. Wich one should be disabled, Query Result Cache? Regards Bernd Am 15.08.2017 um 19:07 schrieb Ahmet Arslan: > Hi Bernd, > > In LUCENE-3758, a new member field added into ComplexPhraseQuery class. But we didn't change its hashCode method accordingly. This caused anomalies in Solr, and Yonik found the bug and fixed hashCode. Your e-mail somehow reminded me this. > Could it be the QueryCache and hashCode method/implementation of Query subclasses. > May be your good and bad example is producing same hashCode? And this is confusing query cache in solr? > Can you disable the query cache, to test it? > By the way, which query parser are you using? I believe SynonymQuery is produced by BM25 similarity, right? > > Ahmet > > > On Friday, August 11, 2017, 2:48:07 PM GMT+3, Bernd Fehling wrote: > > > We just noticed a very strange problem with Solr 6.4.2 QueryParser. > The QueryParser changes the query by itself from time to time. > This happens if doing a search request reload several times at higher rate. > > Good example: > ... > textth:waffenhandel > > ... > textth:waffenhandel > textth:waffenhandel > +SynonymQuery(Synonym(textth:"arms sales" textth:"arms trade"... > +Synonym(textth:"arms sales" textth:"arms trade"... > > > Bad example: > ... > textth:waffenhandel > > ... > textth:waffenhandel > textth:waffenhandel > +textth:rss > +textth:rss > > As you can see in the bad example after several reloads the parsedquery changed to term "rss". > But the original querystring has no "rss" substring at all. That is really strange. > > Anyone seen this before? > > Single index, Solr 6.4.2. > > Regards > Bernd >