lucene-solr-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Robert Muir (JIRA)" <>
Subject [jira] Commented: (SOLR-1312) BufferedTokenStream should use new Lucene 2.9 TokenStream API
Date Fri, 02 Apr 2010 03:42:27 GMT


Robert Muir commented on SOLR-1312:

Hello, I recommend we cancel this issue.

No Solr tokenstreams extend this BufferedTokenStream API anymore, as it is bound to Token
and does not support reuse.
Currently this class is marked deprecated in trunk, with a backwards compatibility layer.

If we think that an API like this is useful, we should make a new BufferedTokenStream-like
API that uses AttributeSource
instead of Token, but this API would not support reuse and would not be very performant, as
it would have to use
cloneAttributes() and copyTo() instead of captureState() and restoreState()

> BufferedTokenStream should use new Lucene 2.9 TokenStream API
> -------------------------------------------------------------
>                 Key: SOLR-1312
>                 URL:
>             Project: Solr
>          Issue Type: Improvement
>          Components: Schema and Analysis
>    Affects Versions: 1.4
>            Reporter: Tom Burton-West
>            Priority: Minor
> Since Solr 1.4 will be using Lucene 2.9, the Solr TokenFilters should probably be updated
 to use the Lucene 2.9 TokenStream API.   This issue is to put BufferedTokenStream on the
list of Filters that need updating. 

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message