From solr-user-return-143564-archive-asf-public=cust-asf.ponee.io@lucene.apache.org Fri Sep 7 16:40:26 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id 0C9B2180672 for ; Fri, 7 Sep 2018 16:40:25 +0200 (CEST) Received: (qmail 50409 invoked by uid 500); 7 Sep 2018 14:40:24 -0000 Mailing-List: contact solr-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: solr-user@lucene.apache.org Delivered-To: mailing list solr-user@lucene.apache.org Received: (qmail 50397 invoked by uid 99); 7 Sep 2018 14:40:23 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 07 Sep 2018 14:40:23 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 04F351A1699 for ; Fri, 7 Sep 2018 14:40:23 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.9 X-Spam-Level: * X-Spam-Status: No, score=1.9 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, KAM_SHORT=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (1024-bit key) header.d=opensourceconnections.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id HpQgGNNAua9X for ; Fri, 7 Sep 2018 14:40:21 +0000 (UTC) Received: from mail-lf1-f46.google.com (mail-lf1-f46.google.com [209.85.167.46]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 2C6D65F295 for ; Fri, 7 Sep 2018 14:40:21 +0000 (UTC) Received: by mail-lf1-f46.google.com with SMTP id q13-v6so12255343lfc.2 for ; Fri, 07 Sep 2018 07:40:21 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=opensourceconnections.com; s=google; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=+UQ/o7ISnNstoIs6r6LeGWWpmWsfLXtqsIn1ezFkpeE=; b=FSVuwfoEGLLiVBLDVgsM2QAlqIIK88pS5/nEmSpaFhkqwaB/OOdvS8QLx8QVOWcjKM iHs+ZFttmvwSRrSEUOAmuwfHT8but5/+y7n7+t9b3t4v3qCJNiJRoiGJ+DJvcByRzj2o /DYq1faF4GAocfQHWU2Q3fY59KHwAo0LH4atU= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=+UQ/o7ISnNstoIs6r6LeGWWpmWsfLXtqsIn1ezFkpeE=; b=WPz9HPorrkTTVPa65ljfLM6ghN7Xg623Y/cKT6N1TeKN9wTD/VhDPDdgjS2+WvqJL9 t6LQsC9rcPpOiqPHpso3IIFRcnaQedhzcwRHg5M/kKEIEpAhQvNUjkrvAM/Dy+I1/+Wp AJDkz4Gs6ZFaYY/l0RWJvyQItVRfXtqcHrxZx3VJu0UmGACAFYrvSW6vyRBAihHgh8x8 bXuI9OIrY9Qh8khSrOgeLGHxUHS+YImqImC4Qx2+zsNU+RCQWssKE7ok5C1r4zenH7c1 yhGyKvgA+ugZytq4+9GbknxdsjTBL+LyVGvozXKfuB0P4ac/MF/M11R4wwADou27A9vv p3Ew== X-Gm-Message-State: APzg51B4WZt5HgwhRokhxIpMNxKPNuMpgrgj5fRqAYE0YVc2z3hT5vsD rvNi+yFzMCK0gDwclZrBUo3BzrnFOly0ULIbl/cw21Dc X-Google-Smtp-Source: ANB0Vdb+xbzx9GTnkNaVEv2rnqrm20W+ljheJ0no639iS0Mt//fEwLIvafrBJgxU8nN5GZkG3vWzgs0gKcnRFpmD0RQ= X-Received: by 2002:a19:d5c8:: with SMTP id m191-v6mr5207107lfg.134.1536331220199; Fri, 07 Sep 2018 07:40:20 -0700 (PDT) MIME-Version: 1.0 References: <733656f4-1c76-abda-eee0-676da82dcf78@flax.co.uk> In-Reply-To: <733656f4-1c76-abda-eee0-676da82dcf78@flax.co.uk> From: Doug Turnbull Date: Fri, 7 Sep 2018 10:40:08 -0400 Message-ID: Subject: Re: MLT in Cloud Mode - Not Returning Fields? To: solr-user@lucene.apache.org Content-Type: multipart/alternative; boundary="000000000000a33d28057548fc3e" --000000000000a33d28057548fc3e Content-Type: text/plain; charset="UTF-8" Looks like this is indeed a bug My colleague debugged this behavior and it turns out that Solr only requests id and score from the shards, and not the user-specified field list. You can see that on this line https://github.com/apache/lucene-solr/blob/branch_7_4/solr/core/src/java/org/apache/solr/handler/component/MoreLikeThisComponent.java#L342 Happy to create a Jira ticket -Doug On Mon, Sep 3, 2018 at 5:23 AM Charlie Hull wrote: > On 31/08/2018 19:36, Doug Turnbull wrote: > > Hello, > > > > We're working on a Solr More Like This project (Solr 6.6.2), using the > More > > Like This searchComponent. What we note is in standalone Solr, when we > > request MLT using the search component, we get every more like this > > document fully formed with complete fields in the moreLikeThis section. > > Hey Doug, > > IIRC there wasn't a lot of support for MLT in cloud mode a few years > ago, and there are certainly still a few open issues around cloud support: > https://issues.apache.org/jira/browse/SOLR-4414 > https://issues.apache.org/jira/browse/SOLR-5480 > Maybe there are some hints in the ticket comments about different ways > to do what you want. > > Cheers > > Charlie > > > > > In cloud, however, with the exact same query and config, we only get the > > doc ids under "moreLikeThis" requiring us to fetch the metadata > associated > > with each document. > > > > I can't easily share an example due to confidentiality, but I want to > check > > if we're missing something? Documentation doesn't mention any > limitations. > > The only interesting note I've found is this one which points to a > > potential difference in behavior > > > >> The Cloud MLT Query Parser uses the realtime get handler to retrieve > the > > fields to be mined for keywords. Because of the way the realtime get > > handler is implemented, it does not return data for fields populated > using > > copyField. > > > > https://stackoverflow.com/a/46307140/8123 > > > > Any thoughts? > > > > -Doug > > > > > -- > Charlie Hull > Flax - Open Source Enterprise Search > > tel/fax: +44 (0)8700 118334 <+44%20870%20011%208334> > mobile: +44 (0)7767 825828 <+44%207767%20825828> > web: www.flax.co.uk > -- CTO, OpenSource Connections Author, Relevant Search http://o19s.com/doug --000000000000a33d28057548fc3e--