lucene-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Joel Bernstein (Jira)" <j...@apache.org>
Subject [jira] [Comment Edited] (SOLR-13892) Add postfilter support to {!join} queries
Date Tue, 05 Nov 2019 23:59:00 GMT

    [ https://issues.apache.org/jira/browse/SOLR-13892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16967960#comment-16967960
] 

Joel Bernstein edited comment on SOLR-13892 at 11/5/19 11:58 PM:
-----------------------------------------------------------------

I think MultiTermQueryConstantScoreWrapper will come into play with the JoinUtil/TermsQuery
implementation. This can be slow when there are a large number of join terms because seeks
into the terms enum need to be done for entire join list for each segment. So for  400,000
join terms and 50 segments it would make 20,000,000 seeks into the terms enum.

The postfilter approach avoids this altogether. 


was (Author: joel.bernstein):
I think MultiTermQueryConstantScoreWrapper will come into play with the JoinUtil/TermsQuery
implementation. This can be slow when there are a large number of terms because seeks into
the terms enum needs to be done for entire join list for each segment. So for let's say 400,000
join terms and 50 segments it would make 20,000,000 seeks into the index.

The postfilter approach avoids this altogether. 

> Add postfilter support to {!join} queries
> -----------------------------------------
>
>                 Key: SOLR-13892
>                 URL: https://issues.apache.org/jira/browse/SOLR-13892
>             Project: Solr
>          Issue Type: Improvement
>      Security Level: Public(Default Security Level. Issues are Public) 
>          Components: query parsers
>    Affects Versions: master (9.0)
>            Reporter: Jason Gerlowski
>            Priority: Major
>         Attachments: SOLR-13892.patch
>
>
> The JoinQParserPlugin would be a lot performant in many use-cases if it could operate
as a post-filter, especially when doc-values for the involved fields are available.
> With this issue, I'd like to propose a post-filter implementation for the {{join}} qparser.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For additional commands, e-mail: issues-help@lucene.apache.org


Mime
View raw message