Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: java-user@lucene.apache.org
MIME-Version: 1.0
In-Reply-To: <CAF8TkC6tj7OJAmMS0AuNde+SBK1J7LoM5okX62ypNx62esw_og@mail.gmail.com>
References: <CADitDkmHf-UDkSkdajCHJ70JFnORLYNW5WxqF0ijt0Sf7eTcdQ@mail.gmail.com>
 <CAGUSZHBP1aTUpJw9QR8Ca3K5arHyzAh-uGBU9hLE-g6gq3Pj1w@mail.gmail.com>
 <CADitDkkwtAj4ruTii7HjZfY+Qqdbe8jZ8TnMSGf9+CS_UaUMQA@mail.gmail.com>
 <CAGUSZHD+zmQuQ6g2Jyohyazi4egWXAJbR1Ermkxzh8PjOe+hhQ@mail.gmail.com>
 <CADitDkm0emkPoUMUuSD_2VJ0Cvy0cC7SdPKK6hsfOD2R3f26sg@mail.gmail.com>
 <CAGUSZHBpz33XnCQPdyscLeBWiJzuui_xWMef0RuT6TYh7DdRjA@mail.gmail.com>
 <CADitDkn1FeCMQTr=t7r0GsjYtQfsaxxBaF92ApO5hN6OVTbGyQ@mail.gmail.com>
 <CADitDkmFtTO9k5O5RKSjP0wP+GMvU=v72wmCBnT_im7H381TFg@mail.gmail.com>
 <CAF8TkC6kxs5UrZZf_Srn10pE7P0GLKJewR+kMqnwvpE7OfeZww@mail.gmail.com>
 <CADitDkk00POA9zaJKrYA5+0yiWHGx+2DvjLPjxMwuvxRbqsHJw@mail.gmail.com>
 <CADitDkmzKyQW4s85R=S-DeY6vyM82LTRD3CkHt9FC_9LXAukZQ@mail.gmail.com> <CAF8TkC6tj7OJAmMS0AuNde+SBK1J7LoM5okX62ypNx62esw_og@mail.gmail.com>
From: Vadim Gindin <vgindin@detectum.com>
Date: Thu, 14 Dec 2017 14:45:10 +0500
Message-ID: <CADitDknX4wnSXWZE-qZGUMku95yLssnUAJs7e6_MzzcOycnuWg@mail.gmail.com>
Subject: Re: Tracking that all query terms are matched in one document
To: java-user@lucene.apache.org
Content-Type: multipart/alternative; boundary="001a114a930675b1fe056049bdae"
archived-at: Thu, 14 Dec 2017 09:45:18 -0000

--001a114a930675b1fe056049bdae
Content-Type: text/plain; charset="UTF-8"

Thank you

On Wed, Dec 13, 2017 at 3:32 PM, Mikhail Khludnev <mkhl@apache.org> wrote:

> There are two algorithm for scoring disjunction: term-a-time, doc-at-time.
> The former was called BooleanScorer and the later was called
> BooleanScorer2.
> I remember that they was drastically renamed and/or replaced with
> BulkScorer or so. Anyway, you need to find a way to prevent term-at-time
> scoring, when FakeScorer is injected.
> You need to make it score doc-at-time. As I told you, it's far way.
>
> On Wed, Dec 13, 2017 at 11:55 AM, Vadim Gindin <vgindin@detectum.com>
> wrote:
>
> > Hi Michael,
> >
> > I've tried to implement such case but faced with the following problem. I
> > recall, that my Query is combined with several ConstantScoreQuery with
> > BooleanQuery. I wrote custom Collector as follows:
> >
> > @Override
> > public void setScorer(Scorer scorer) throws IOException {
> >     this.scorer = scorer;
> >
> > }
> >
> > @Override
> > public void collect(int doc) throws IOException {
> >     System.out.println("doc=" + doc);
> >     diveIntoScorers(this.scorer);
> > }
> >
> > and, when I'm diving recursively to child scorers I'm facing new
> > UnsupportedOperationException error. It happens because of the following
> > code in BooleanScorer:
> >
> > @Override
> > public int score(LeafCollector collector, Bits acceptDocs, int min,
> > int max) throws IOException {
> >   fakeScorer.doc = -1;
> >   collector.setScorer(fakeScorer);
> >
> > Later fakeScorer throws an Exception.
> >
> > How did you implement your similar functionality?
> > How to avoid this?
> >
> > Thanks,
> > Vadim Gindin
> >
> > On Fri, Dec 8, 2017 at 2:01 PM, Vadim Gindin <vgindin@detectum.com>
> wrote:
> >
> > > Thank's for your help. I'll try that.
> > >
> > > On Tue, Dec 5, 2017 at 4:18 PM, Mikhail Khludnev <mkhl@apache.org>
> > wrote:
> > >
> > >> Vadim,
> > >> You can create a collector which checks Scorer.getChildren()
> > >> https://issues.apache.org/jira/browse/LUCENE-7628 but it's way
> > >> cumbersome.
> > >> I'd suggest to avoid this if it's possible. However, Elastic does
> > >> something
> > >> like this with named queries or so.
> > >> I've told about this few years ago
> > >> https://www.youtube.com/watch?v=sGVyUdNGBgw
> > >>
> > >> On Tue, Dec 5, 2017 at 12:36 PM, Vadim Gindin <vgindin@detectum.com>
> > >> wrote:
> > >>
> > >> > I'm not sure here that I will be able to track somehow that
> different
> > >> terms
> > >> > were matched to the same document...
> > >> >
> > >> > I'm thinking more about little another way: when query scores some
> > >> document
> > >> > - save the query term for that document somewhere. Probably it would
> > be
> > >> > some map in some class SearchContext. I could write something like
> > this:
> > >> >
> > >> > SearchContext sc = getSearchContext();                    // -  does
> > >> such
> > >> > search context exist in Lucene? Maybe QueryContext
> > >> > sc.getDocTerms().get(docID).add(query.getTerm()));  // docTerms
> here
> > >> is a
> > >> > Map<Int, List<String>> - where the key - is a document ID and the
> > value
> > >> -
> > >> > is a list of terms by whom this document was matched.
> > >> >
> > >> > I need to save somewhere the document ID and the term matched that
> > >> > document. Could somebody advise me an appropriate place?
> > >> >
> > >> > Regards,
> > >> > Vadim Gindin
> > >> >
> > >> >
> > >> > On Tue, Dec 5, 2017 at 12:04 PM, Vadim Gindin <vgindin@detectum.com
> >
> > >> > wrote:
> > >> >
> > >> > > For example like this:
> > >> > >
> > >> > > BooleanQuery.Builder expected = new BooleanQuery.Builder();
> > >> > >
> > >> > > Query param_vendor = new BoostQuery(new ConstantScoreQuery(new
> > >> > TermQuery(new Term("param_vendor", queryStr))), 5f);
> > >> > > Query param_model = new BoostQuery(new ConstantScoreQuery(new
> > >> > TermQuery(new Term("param_model", queryStr))), 5f);
> > >> > > Query param_value = new BoostQuery(new ConstantScoreQuery(new
> > >> > TermQuery(new Term("param_value", queryStr))), 3f);
> > >> > > Query param_name = new BoostQuery(new ConstantScoreQuery(new
> > >> > TermQuery(new Term("param_name", queryStr))), 4f);
> > >> > >
> > >> > > BooleanQuery bq = expected
> > >> > >         .add(param_vendor, BooleanClause.Occur.SHOULD)
> > >> > >         .add(param_model, BooleanClause.Occur.SHOULD)
> > >> > >         .add(param_value, BooleanClause.Occur.SHOULD)
> > >> > >         .add(param_name, BooleanClause.Occur.SHOULD)
> > >> > >         .setMinimumNumberShouldMatch(1)
> > >> > >         .build();
> > >> > >
> > >> > > return new BoostQuery(bq, queryBoost);
> > >> > >
> > >> > >
> > >> > > Vadim
> > >> > >
> > >> > > On Tue, Dec 5, 2017 at 9:24 AM, Michael Sokolov <
> msokolov@gmail.com
> > >
> > >> > > wrote:
> > >> > >
> > >> > >> Well how did you make the original query?
> > >> > >>
> > >> > >> On Dec 4, 2017 12:05 PM, "Vadim Gindin" <vgindin@detectum.com>
> > >> wrote:
> > >> > >>
> > >> > >> > Yes, thanks. My question is exactly about how to create
> "another
> > >> extra
> > >> > >> > query that requires all the terms in the original query"
> > >> > >> >
> > >> > >> > On Mon, Dec 4, 2017 at 6:50 PM, Michael Sokolov <
> > >> msokolov@gmail.com>
> > >> > >> > wrote:
> > >> > >> >
> > >> > >> > > I'm just saying, that when you form your query, you could
> also
> > >> > create
> > >> > >> > > another extra query that requires all the terms in the
> original
> > >> > query,
> > >> > >> > and
> > >> > >> > > then combine it with the original query in a boolean where
> the
> > >> > >> original
> > >> > >> > > query is required and the extra query is optional. That will
> > >> give a
> > >> > >> boost
> > >> > >> > > when all the terms are found, although I think the scores
> will
> > be
> > >> > >> added,
> > >> > >> > > not multiplied.
> > >> > >> > >
> > >> > >> > > On Dec 4, 2017 5:22 AM, "Vadim Gindin" <vgindin@detectum.com
> >
> > >> > wrote:
> > >> > >> > >
> > >> > >> > > > Thanks, Michael!
> > >> > >> > > >
> > >> > >> > > > Yes, I'm sure. Could you explain your proposal in more
> > detail?
> > >> > >> > > >
> > >> > >> > > > Regards,
> > >> > >> > > > Vadim Gindin
> > >> > >> > > >
> > >> > >> > > > On Mon, Dec 4, 2017 at 3:18 PM, Michael Sokolov <
> > >> > msokolov@gmail.com
> > >> > >> >
> > >> > >> > > > wrote:
> > >> > >> > > >
> > >> > >> > > > > You could combine a Boolean and query with the same
> terms,
> > >> as an
> > >> > >> > > optional
> > >> > >> > > > > clause. Are you sure about the requirement to multiply
> the
> > >> score
> > >> > >> in
> > >> > >> > > that
> > >> > >> > > > > case?
> > >> > >> > > > >
> > >> > >> > > > > On Dec 4, 2017 5:13 AM, "Vadim Gindin" <
> > vgindin@detectum.com
> > >> >
> > >> > >> wrote:
> > >> > >> > > > >
> > >> > >> > > > > > Hi all.
> > >> > >> > > > > >
> > >> > >> > > > > > I need to track that all query terms are matched in one
> > >> > >> document.
> > >> > >> > > When
> > >> > >> > > > > all
> > >> > >> > > > > > terms are matched I need to multiply the score of such
> > >> > document
> > >> > >> to
> > >> > >> > > some
> > >> > >> > > > > > constant coefficient.
> > >> > >> > > > > >
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >> >
> > >> > >>
> > >> > >
> > >> > >
> > >> >
> > >>
> > >>
> > >>
> > >> --
> > >> Sincerely yours
> > >> Mikhail Khludnev
> > >>
> > >
> > >
> >
>
>
>
> --
> Sincerely yours
> Mikhail Khludnev
>

--001a114a930675b1fe056049bdae--