Mailing-List: contact solr-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: solr-user@lucene.apache.org
MIME-Version: 1.0
In-Reply-To: <CAMFB9e=0UyL5Dz3XGXrb3Q0uZx0xhY_uyEfQaD6YMC9AYoqs6Q@mail.gmail.com>
References: <CAMFB9emKp=FS5RAi7uL846LsR-GUmO7KUkkY-p-W6G3pv0Bysg@mail.gmail.com>
 <CAF8TkC7nT8qekNE7oeSq7BZMod5uoVuQ1nxFHYR1=eOXpb=AHQ@mail.gmail.com>
 <CAMFB9ekAfFSBj3uJS0N9H-vRRCEhrEDFg6FOf6CYfFKqM2p5ww@mail.gmail.com>
 <CAF8TkC5nnzJ2kj-zEzZvxp4sELR6ymmJ-yeoqUfEZXRC-JzXqg@mail.gmail.com>
 <CAMFB9e=Wm9in_eam7S4xtLNk-iETuBO7fEXUHr+oCBj9-LkSxA@mail.gmail.com>
 <CAF8TkC4qUO6Hmmiy5TKumvE-dH=OFNGK1HcWLTJvjDbsyVfiwQ@mail.gmail.com> <CAMFB9e=0UyL5Dz3XGXrb3Q0uZx0xhY_uyEfQaD6YMC9AYoqs6Q@mail.gmail.com>
From: Mikhail Khludnev <mkhl@apache.org>
Date: Sat, 7 Jan 2017 00:13:34 +0300
Message-ID: <CAF8TkC6HfWHHuJ416NVJ60kxkiSpAh-i8S5=otsX_mCniiPtRg@mail.gmail.com>
Subject: Re: Subqueries
To: solr-user <solr-user@lucene.apache.org>
Content-Type: multipart/alternative; boundary=001a1144c4749d94f50545737d8f
archived-at: Fri, 06 Jan 2017 21:13:38 -0000

--001a1144c4749d94f50545737d8f
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

Denormalising works on small numbers, but it hits ceil quite soon, because
it scales hard.
People did such snippet enrichment in apps for ages. There is nothing
special in it.
Probably someone can port it to 4.10 as a plugin.

On Sat, Jan 7, 2017 at 12:08 AM, Peter Matthew Eichman <peichman@umd.edu>
wrote:

> Thanks, we will look into the feasibility of a Solr upgrade. If not, is
> there anything in 4.10 that would allow us to do something similar, or
> would we be stuck with denormalizing our data at index time?
>
> -Peter
>
> On Fri, Jan 6, 2017 at 4:03 PM, Mikhail Khludnev <mkhl@apache.org> wrote:
>
> > https://issues.apache.org/jira/browse/SOLR-8208 is resolved for 6.1.
> > I don't know why 4.10 didn't throw exception on referring to [subquery]=
,
> > which is absent there.
> >
> > On Fri, Jan 6, 2017 at 6:23 PM, Peter Matthew Eichman <peichman@umd.edu=
>
> > wrote:
> >
> > > Hi Mikhail,
> > >
> > > I've turned on DEBUG level logging, but I still only see the main
> request
> > > logged, and no requests for the subqueries.
> > >
> > > Could it be a version issue? We are running Solr 4.10.
> > >
> > > Thanks,
> > > -Peter
> > >
> > > On Fri, Jan 6, 2017 at 1:56 AM, Mikhail Khludnev <mkhl@apache.org>
> > wrote:
> > >
> > > > Peter,
> > > > Subquery should also log its' request. Can't you find it in log?
> > > >
> > > > On Fri, Jan 6, 2017 at 1:19 AM, Peter Matthew Eichman <
> > peichman@umd.edu>
> > > > wrote:
> > > >
> > > > > Hello Mikhail,
> > > > >
> > > > > I put pcdm_members into the fl, and it is definitely stored. I
> tried
> > > > adding
> > > > > the logParamsList, but all I see in the log is
> > > > > 183866104 [qtp1778535015-14] INFO  org.apache.solr.core.SolrCore =
 =E2=80=93
> > > > > [fedora4] webapp=3D/solr path=3D/select params=3D{q=3Did:"https:/=
/
> > > > > fcrepolocal/fcrepo/rest/pcdm/19/31/3c/1a/19313c1a-6ab4-
> > > > > 4305-93ec-12dfdf01ba74"&members.logParamsList=3Dq,fl,
> > > > > rows,row.pcdm_members&indent=3Dtrue&fl=3Dmembers:[subquery]&
> > > > > members.fl=3Did,title&members.q=3D{!terms+f%3Did+v%3D$row.pcdm_
> > > > > members}&wt=3Djson&_=3D1483654385162} hits=3D1 status=3D0 QTime=
=3D0
> > > > >
> > > > > Still getting no members key in the output:
> > > > >
> > > > > {
> > > > >   "responseHeader": {
> > > > >     "status": 0,
> > > > >     "QTime": 1,
> > > > >     "params": {
> > > > >       "q": "id:\"https://fcrepolocal/fcrepo/rest/pcdm/19/31/3c/1a=
/
> > > > > 19313c1a-6ab4-4305-93ec-12dfdf01ba74\"",
> > > > >       "members.logParamsList": "q,fl,rows,row.pcdm_members",
> > > > >       "indent": "true",
> > > > >       "fl": "pcdm_members,members:[subquery]",
> > > > >       "members.fl": "id,title",
> > > > >       "members.q": "{!terms f=3Did v=3D$row.pcdm_members}",
> > > > >       "wt": "json",
> > > > >       "_": "1483654538166"
> > > > >     }
> > > > >   },
> > > > >   "response": {
> > > > >     "numFound": 1,
> > > > >     "start": 0,
> > > > >     "docs": [
> > > > >       {
> > > > >         "pcdm_members": [
> > > > >           "https://fcrepolocal/fcrepo/rest/pcdm/28/2e/5b/f5/
> > > > > 282e5bf5-74c8-4148-9c1a-4ebead6435cb",
> > > > >           "https://fcrepolocal/fcrepo/rest/pcdm/6e/7c/36/2f/
> > > > > 6e7c362f-d239-4534-abd7-28caa24a134c",
> > > > >           "https://fcrepolocal/fcrepo/rest/pcdm/6e/e3/a6/33/
> > > > > 6ee3a633-998e-4f36-b80f-d76bcbe0d352",
> > > > >           "https://fcrepolocal/fcrepo/rest/pcdm/8a/d9/c7/62/
> > > > > 8ad9c762-4391-428d-b1ad-be5ac3e06c42"
> > > > >         ]
> > > > >       }
> > > > >     ]
> > > > >   }
> > > > > }
> > > > >
> > > > > Is $row.pcdm_members the right way to refer to the pcdm_members
> field
> > > > > of the current document in the subquery? Is the multivalued natur=
e
> of
> > > > > the field a problem? I have tried adding separator=3D' ' to both =
the
> > > > > [subquery] and {!terms}, but to no avail.
> > > > >
> > > > > Thanks,
> > > > > -Peter
> > > > >
> > > > > On Thu, Jan 5, 2017 at 4:38 PM, Mikhail Khludnev <mkhl@apache.org=
>
> > > > wrote:
> > > > >
> > > > > > Hello,
> > > > > >
> > > > > > Can you add pcdm_members into fl to make sure it's stored?
> > > > > > Also please add the following param
> > > > > > members.logParamsList=3Dq,fl,rows,row.pcdm_members,
> > > > > > and check logs then.
> > > > > >
> > > > > > On Thu, Jan 5, 2017 at 9:46 PM, Peter Matthew Eichman <
> > > > peichman@umd.edu>
> > > > > > wrote:
> > > > > >
> > > > > > > Hello all,
> > > > > > >
> > > > > > > I am attempting to use a subquery to enrich a query with the
> > titles
> > > > of
> > > > > > > related objects. Each document in my index may have 1 or more
> > > > > > pcdm_members
> > > > > > > and pcdm_related_objects fields, whose values are ids of othe=
r
> > > > > documents
> > > > > > in
> > > > > > > the index. Those documents in turn have reciprocal
> pcdm_member_of
> > > and
> > > > > > > pcdm_related_object_of fields.
> > > > > > >
> > > > > > > In the Blacklight app I am working on, we want to enrich the
> > > display
> > > > > of a
> > > > > > > document with the titles of its members and related objects
> > using a
> > > > > > > subquery. However, this is out first foray into subqueries an=
d
> > > things
> > > > > > > aren't working as expected.
> > > > > > >
> > > > > > > I expected the following query to return a "members" key with=
 a
> > > > > document
> > > > > > > list of documents with "id" and "title" keys, but I am gettin=
g
> > > > nothing:
> > > > > > >
> > > > > > > {
> > > > > > >   "responseHeader": {
> > > > > > >     "status": 0,
> > > > > > >     "QTime": 1,
> > > > > > >     "params": {
> > > > > > >       "q": "id:\"https://fcrepolocal/
> > fcrepo/rest/pcdm/19/31/3c/1a/
> > > > > > > 19313c1a-6ab4-4305-93ec-12dfdf01ba74\"",
> > > > > > >       "indent": "true",
> > > > > > >       "fl": "members:[subquery]",
> > > > > > >       "members.fl": "id,title",
> > > > > > >       "members.q": "{!terms f=3Did v=3D$row.pcdm_members}",
> > > > > > >       "wt": "json",
> > > > > > >       "_": "1483641932207"
> > > > > > >     }
> > > > > > >   },
> > > > > > >   "response": {
> > > > > > >     "numFound": 1,
> > > > > > >     "start": 0,
> > > > > > >     "docs": [
> > > > > > >       {}
> > > > > > >     ]
> > > > > > >   }
> > > > > > > }
> > > > > > >
> > > > > > > Any pointers on what I am missing? Are there any configuratio=
n
> > > > settings
> > > > > > in
> > > > > > > solrconfig.xml that I need to be aware of for subqueries to
> work?
> > > > > > >
> > > > > > > Thanks,
> > > > > > > -Peter
> > > > > > >
> > > > > > > --
> > > > > > > Peter Eichman
> > > > > > > Senior Software Developer
> > > > > > > University of Maryland Libraries
> > > > > > > peichman@umd.edu
> > > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > > --
> > > > > > Sincerely yours
> > > > > > Mikhail Khludnev
> > > > > >
> > > > >
> > > > >
> > > > >
> > > > > --
> > > > > Peter Eichman
> > > > > Senior Software Developer
> > > > > University of Maryland Libraries
> > > > > peichman@umd.edu
> > > > >
> > > >
> > > >
> > > >
> > > > --
> > > > Sincerely yours
> > > > Mikhail Khludnev
> > > >
> > >
> > >
> > >
> > > --
> > > Peter Eichman
> > > Senior Software Developer
> > > University of Maryland Libraries
> > > peichman@umd.edu
> > >
> >
> >
> >
> > --
> > Sincerely yours
> > Mikhail Khludnev
> >
>
>
>
> --
> Peter Eichman
> Senior Software Developer
> University of Maryland Libraries
> peichman@umd.edu
>


--=20
Sincerely yours
Mikhail Khludnev

--001a1144c4749d94f50545737d8f--