From solr-user-return-151337-archive-asf-public=cust-asf.ponee.io@lucene.apache.org Sat Jan 4 14:21:16 2020 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [207.244.88.153]) by mx-eu-01.ponee.io (Postfix) with SMTP id E993A18065E for ; Sat, 4 Jan 2020 15:21:15 +0100 (CET) Received: (qmail 12740 invoked by uid 500); 4 Jan 2020 14:21:12 -0000 Mailing-List: contact solr-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: solr-user@lucene.apache.org Delivered-To: mailing list solr-user@lucene.apache.org Received: (qmail 12706 invoked by uid 99); 4 Jan 2020 14:21:11 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 04 Jan 2020 14:21:11 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 39FDFC08A6 for ; Sat, 4 Jan 2020 14:21:10 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -0.201 X-Spam-Level: X-Spam-Status: No, score=-0.201 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-ec2-va.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id 4h1wklU1J0rP for ; Sat, 4 Jan 2020 14:21:08 +0000 (UTC) Received-SPF: Pass (mailfrom) identity=mailfrom; client-ip=209.85.222.196; helo=mail-qk1-f196.google.com; envelope-from=erickerickson@gmail.com; receiver= Received: from mail-qk1-f196.google.com (mail-qk1-f196.google.com [209.85.222.196]) by mx1-ec2-va.apache.org (ASF Mail Server at mx1-ec2-va.apache.org) with ESMTPS id 5814BBC7EB for ; Sat, 4 Jan 2020 14:21:08 +0000 (UTC) Received: by mail-qk1-f196.google.com with SMTP id a203so36426830qkc.3 for ; Sat, 04 Jan 2020 06:21:08 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:content-transfer-encoding:mime-version:subject:date:references :to:in-reply-to:message-id; bh=BvVcMUP7YvlJQSTnAVSgdERyNjWMO8J0B0aDvPmpI3k=; b=LOFBE8EPtZGmsdz9KgNuP/kuLpF0z9vvETTY+gQBJroPVUUQO1MXL5lojTJq1I1/5w ubGrJ6v+UXPsR3ye6DFqjZPo0cR8wjwpUqNXjeFY+quU8A41cSXKZT6GErwVvcbao9EY +5UotN2EsHa4ja6VTGw/CwiL/Z2OiRxQVw3M70mSmf5RtnltwkzXdAg+J3RbfoRKk/Xf +mrduvUrj6uozPyrzC15BBZBTZQs+gWxr0EH3jVNzErrP/9aCz+R83Bwc6wMJgoLofOI fg8vAalgFUse9RQEWTdAR6jm8hs8ZFSkmCHjfxtp5QMmCZkh3KeilsIRlDLynq1lrgou WZ8A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:content-transfer-encoding:mime-version :subject:date:references:to:in-reply-to:message-id; bh=BvVcMUP7YvlJQSTnAVSgdERyNjWMO8J0B0aDvPmpI3k=; b=YzgPXfgJNoAKFiviU+N2wZDpDoYGrPJZsx/Fw6dIHEi7QQNemY7MIT3Ynn2WkQOoR4 Rx7Sv/UhGY9i3NcgDSWldho4j4TPKztfYZWw38cJVF6fIA/H5f13le6cH22Ax8PsrYWI NdpbHBT2S0MDSxrsx7gYcWpsjGPLDLPn/IaxFTdkqwWNJ7Tz0JSjEFVwnh7/s01v8neN 3cjMZj+k6EqSx2GUan9XCere9aols5yY0Dh+EwQgUMfYDQQNbeyZ+XPmSX3/tP7RyBsI cz2nqmjc9Cm6Iar613kZbZzev5bBVZfhYWycHiII7J897UzFgPPeLX/vbcj9Pz9IfLT1 l4dw== X-Gm-Message-State: APjAAAXUn3S+V+AYoESyYqvUQTEBSZ1BoaYoavjytkngM5B3LEMigKmJ SjYStU4rsbPEnxYXnNvG1kSI8cLkFHI= X-Google-Smtp-Source: APXvYqxjIMIW/RvgZrelueD7jH7GmnOECRHNVrRqp/nUtZCn1fRP4xldJPTXOOy4C+yP+yEqv9L01Q== X-Received: by 2002:a37:a1c1:: with SMTP id k184mr75866988qke.66.1578147667634; Sat, 04 Jan 2020 06:21:07 -0800 (PST) Received: from [192.168.1.122] (pool-173-54-218-193.nwrknj.fios.verizon.net. [173.54.218.193]) by smtp.gmail.com with ESMTPSA id g9sm17884882qkm.9.2020.01.04.06.21.06 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Sat, 04 Jan 2020 06:21:06 -0800 (PST) From: Erick Erickson Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 13.0 \(3608.40.2.2.4\)) Subject: Re: Does CloudMLTQParser support getting related documents from different shards? Date: Sat, 4 Jan 2020 09:21:06 -0500 References: To: solr-user@lucene.apache.org In-Reply-To: Message-Id: <496ED107-01CD-4371-A4EE-1444F2FCDA46@gmail.com> X-Mailer: Apple Mail (2.3608.40.2.2.4) What results do you get when you just try it in cloud mode?=20 This is a _parser_, it=E2=80=99s just in charge of parsing the query = and, in this case getting the relevant from the indicated document to add to the query while doing some sanity checking. The bits that distribute the query to shards and collate the results are elsewhere. Best, Erick > On Jan 3, 2020, at 5:43 PM, Arnold Bronley = wrote: >=20 > Hi, >=20 > I have one custom Solr plugin that uses MoreLikeThis class. AFAIK, > MoreLikeThis handler does not support distributed mode and the issue = is > still open for that - https://issues.apache.org/jira/browse/SOLR-5480. >=20 > However, I saw that there is some possibility to use CloudMLTQParser = to > work around above issue. CloudMLTQParser claims to work in distributed = mode > too - https://issues.apache.org/jira/browse/SOLR-6248. When I took a = look > at the code though, > = https://github.com/apache/lucene-solr/blob/2d690885e554dda7b4b4e0f46f2bd9c= acdb32df6/solr/core/src/java/org/apache/solr/search/mlt/CloudMLTQParser.ja= va > , > it seems like that for the document for which we are finding out = related > documents, that document is getting fetched now with real-time get = request > handler. > core.getRequestHandler("/get").handleRequest(request, rsp); > This is good because now that document will get fetched from any shard > existing > in cloud wherever that document exists. >=20 > However, the part where the relevant related documents are supposed to = be > fetched it still uses the same old sort of code. > e.g. MoreLikeThis mlt =3D new MoreLikeThis(req.getSearcher(). > getIndexReader()); >=20 > Isn't getSearcher bound to only the particular shard and AFAIK it does = not > work across shards in cloud? >=20 > So how then, CloudMLTQParser works in SolrCloud mode? Does it even = work?