lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Vadim Gindin <vgin...@detectum.com>
Subject Re: Read DocValue twice
Date Thu, 22 Feb 2018 14:14:22 GMT
Thank you very very much for your time and efforts

On Thu, Feb 22, 2018 at 6:23 PM, Adrien Grand <jpountz@gmail.com> wrote:

> You are trying to use explain for more than what it has been designed for.
> Calling explain on the top hits is fine, but it seems that you need/want to
> do this for all matches. We don't have a solution for this.
>
> Caching the scorer doesn't work since scorers can only be iterated once.
>
> Le jeu. 22 févr. 2018 à 12:11, Vadim Gindin <vgindin@detectum.com> a
> écrit :
>
> > I'd like to use "explain" mechanism to output some additional match
> > information: scoring formula, detailed matching information and so on.
> But
> > now it seems, "explain" works slower even than just logging of matching
> > information to a file from score() method.
> >
> > - What is the most effective way to do this? Is there a possibility to
> > accelerate "explain", for example with scorer caching?
> > - Lucene uses the only Scorer (for entire segment) for calling score()
> > method. What about explain()?
> > - Iterators are really - readable-once only?
> >
> > Regards,
> > Vadim Gindin
> >
> > On Thu, Feb 22, 2018 at 3:03 PM, Adrien Grand <jpountz@gmail.com> wrote:
> >
> > > If you are talking about explanations, then yes, it's fine. Explain()
> is
> > > used for debugging, it is fine if it is slow. However Lucene creates
> only
> > > one Scorer for all documents of an entire segment when it comes to
> > actually
> > > running a query.
> > >
> > > Le jeu. 22 févr. 2018 à 07:06, Vadim Gindin <vgindin@detectum.com>
a
> > > écrit :
> > >
> > > > Adrien, thank's a lot!  It looks like a working solution for my
> bugs. I
> > > > really appreciate it.
> > > >
> > > > I just want to ask. Is it really effective way create a Scorer for
> > every
> > > > document? Can we say, that it's designed for Scorer to be lightweight
> > and
> > > > fast enough so?
> > > >
> > > > On Wed, Feb 21, 2018 at 6:42 PM, Adrien Grand <jpountz@gmail.com>
> > wrote:
> > > >
> > > > > This might not solve all problems, but you should stop caching the
> > > weight
> > > > > in the query and stop caching the scorer in the weight: just
> create a
> > > new
> > > > > scorer in calls to explain().
> > > > >
> > > > > Le mer. 21 févr. 2018 à 14:05, Vadim Gindin <vgindin@detectum.com>
> a
> > > > > écrit :
> > > > >
> > > > > > The test gives the following error:
> > > > > >
> > > > > > java.lang.AssertionError: Docs enums are only supposed to be
> > consumed
> > > > in
> > > > > > the thread in which they have been acquired. But was acquired
in
> > > > > > Thread[elasticsearch[node_s2][search][T#4],5,TGRP-
> > > CustomQueryParserIT]
> > > > > and
> > > > > > consumed in
> > > > > > Thread[elasticsearch[node_s2][search][T#2],5,TGRP-
> > > CustomQueryParserIT].
> > > > > > at __randomizedtesting.SeedInfo.seed([935231818B6C9F26]:0)
> > > > > > at
> > > > > >
> > > > > > org.apache.lucene.index.AssertingLeafReader.assertThread(
> > > > > AssertingLeafReader.java:42)
> > > > > > at
> > > > > >
> > > > > > org.apache.lucene.index.AssertingLeafReader.access$
> > > > > 000(AssertingLeafReader.java:36)
> > > > > > at
> > > > > >
> > > > > > org.apache.lucene.index.AssertingLeafReader$
> > > > > AssertingPostingsEnum.advance(AssertingLeafReader.java:330)
> > > > > > at
> > > > > >
> > > > > > org.apache.lucene.search.DisjunctionDISIApproximation.advance(
> > > > > DisjunctionDISIApproximation.java:66)
> > > > > > at
> > > > > >
> > > > > > com.detectum.query.phrase.PrizeDisjunctionScorer.explain(
> > > > > PrizeDisjunctionScorer.java:220)
> > > > > >
> > > > > > from explain() method.
> > > > > >
> > > > > >
> > > > > >
> > > > > > On Tue, Feb 20, 2018 at 8:03 PM, Vadim Gindin <
> > vgindin@detectum.com>
> > > > > > wrote:
> > > > > >
> > > > > > > Probably it is not possible to attach files from email
letter.
> > Here
> > > > > they
> > > > > > > are:
> > > > > > >
> > > > > > > ConstTermScorer.java
> > > > > > > <
> > > > http://lucene.472066.n3.nabble.com/file/t493564/ConstTermScorer.java
> >
> > > > > > > PrizeDisjunctionScorer.java
> > > > > > > <http://lucene.472066.n3.nabble.com/file/t493564/
> > > > > > > PrizeDisjunctionScorer.java>
> > > > > > > PhraseQuery.java
> > > > > > > <
> > http://lucene.472066.n3.nabble.com/file/t493564/PhraseQuery.java>
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > --
> > > > > > > Sent from: http://lucene.472066.n3.
> nabble.com/Lucene-Java-Users-
> > > > > > > f532864.html
> > > > > > >
> > > > > > > ------------------------------------------------------------
> > > ---------
> > > > > > > To unsubscribe, e-mail: java-user-unsubscribe@lucene.
> apache.org
> > > > > > > For additional commands, e-mail:
> > java-user-help@lucene.apache.org
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message