lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "David Smiley (JIRA)" <j...@apache.org>
Subject [jira] [Created] (LUCENE-8332) New ConcatenateGraphTokenStream (move/rename CompletionTokenStream)
Date Fri, 25 May 2018 03:15:00 GMT
David Smiley created LUCENE-8332:
------------------------------------

             Summary: New ConcatenateGraphTokenStream (move/rename CompletionTokenStream)
                 Key: LUCENE-8332
                 URL: https://issues.apache.org/jira/browse/LUCENE-8332
             Project: Lucene - Core
          Issue Type: New Feature
          Components: modules/analysis
            Reporter: David Smiley
            Assignee: David Smiley


Lets move and rename the CompletionTokenStream in the suggest module into the analysis module
renamed as ConcatenateGraphTokenStream. See comments in LUCENE-8323 leading to this idea.
Such a TokenStream (or TokenFilter?) has several uses:
 * for the suggest module
 * by the SolrTextTagger for NER/ERD use cases – SOLR-12376
 * for doing complete match search efficiently

It will need a factory – a TokenFilterFactory, even though we don't have a TokenFilter based
subclass of TokenStream.

It appears there is no back-compat concern in it suddenly disappearing from the suggest module
as it's marked experimental and it only seems to be public now perhaps due to some technicality
(it has package level constructors).



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message