lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Chris Hostetter <hossman_luc...@fucit.org>
Subject Re: Using more tokens in TokenFilter :(
Date Sat, 17 May 2008 17:51:54 GMT

each call of next can only return one token ... if you wnat to return more 
then one token based on each token you find in "input" then you need to 
buffer them.

There's an abstract class in Solr that you can look at to see how this can 
be done, and you can subclass it to get all the benefits...

http://svn.apache.org/viewvc/lucene/solr/trunk/src/java/org/apache/solr/analysis/BufferedTokenStream.java?revision=643465&view=markup


-Hoss


---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


Mime
View raw message