lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jim Ferenczi (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (LUCENE-7747) QueryBuilder should build side-paths query (graph query) lazily
Date Fri, 17 Mar 2017 15:19:41 GMT

     [ https://issues.apache.org/jira/browse/LUCENE-7747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Jim Ferenczi resolved LUCENE-7747.
----------------------------------
       Resolution: Fixed
    Fix Version/s: master (7.0)

Thanks [~mikemccand] !

> QueryBuilder should build side-paths query (graph query) lazily
> ---------------------------------------------------------------
>
>                 Key: LUCENE-7747
>                 URL: https://issues.apache.org/jira/browse/LUCENE-7747
>             Project: Lucene - Core
>          Issue Type: Improvement
>            Reporter: Jim Ferenczi
>            Priority: Blocker
>             Fix For: master (7.0), 6.5
>
>         Attachments: LUCENE-7747.patch
>
>
> In LUCENE-7638 we generate a query for each multi-token path in the graph and combine
them at the end in a boolean query.  
> This can lead to OOM when the number of path is big, instead we should build the disjunction
of these paths lazily in order to throw "too many clauses" early if the number of paths is
bigger than max boolean clauses.
> For instance a shingle filter with shingles of different size produces a graph with multiple
side paths at each position. If the input query has a lot of tokens, the number of paths (query)
created is exponential. For this use case it is maybe preferable to disallow graph query analysis
completely but when allowed we should also be protected against combinatorial explosion.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message