lucene-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Joel Bernstein (Jira)" <j...@apache.org>
Subject [jira] [Comment Edited] (SOLR-13892) Add postfilter support to {!join} queries
Date Wed, 06 Nov 2019 00:04:00 GMT

    [ https://issues.apache.org/jira/browse/SOLR-13892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16967960#comment-16967960
] 

Joel Bernstein edited comment on SOLR-13892 at 11/6/19 12:03 AM:
-----------------------------------------------------------------

I think MultiTermQueryConstantScoreWrapper will come into play with the JoinUtil/TermsQuery
implementation. This can be slow when there are a large number of join terms because seeks
into the terms enum need to be done for the entire join list for each segment. So for 400,000
join terms and 50 segments it would make 20,000,000 seeks into a terms enum.

The postfilter approach avoids this altogether because it doesn't attempt to gather up the
matching docs for join terms. That's why the postfilter approach provides sub-second responses
with 400,000 join terms.


was (Author: joel.bernstein):
I think MultiTermQueryConstantScoreWrapper will come into play with the JoinUtil/TermsQuery
implementation. This can be slow when there are a large number of join terms because seeks
into the terms enum need to be done for the entire join list for each segment. So for 400,000
join terms and 50 segments it would make 20,000,000 seeks into a terms enum.

The postfilter approach avoids this altogether. The postfilter approach provides sub-second
responses with 400,000 join terms.

> Add postfilter support to {!join} queries
> -----------------------------------------
>
>                 Key: SOLR-13892
>                 URL: https://issues.apache.org/jira/browse/SOLR-13892
>             Project: Solr
>          Issue Type: Improvement
>      Security Level: Public(Default Security Level. Issues are Public) 
>          Components: query parsers
>    Affects Versions: master (9.0)
>            Reporter: Jason Gerlowski
>            Priority: Major
>         Attachments: SOLR-13892.patch
>
>
> The JoinQParserPlugin would be a lot performant in many use-cases if it could operate
as a post-filter, especially when doc-values for the involved fields are available.
> With this issue, I'd like to propose a post-filter implementation for the {{join}} qparser.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For additional commands, e-mail: issues-help@lucene.apache.org


Mime
View raw message