lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Uwe Schindler" <...@thetaphi.de>
Subject RE: iterate through tokens in standardtokenizer
Date Sun, 12 Sep 2010 10:14:34 GMT
http://lucene.apache.org/java/3_0_2/api/core/org/apache/lucene/analysis/pack
age-summary.html

Read the example for "Using the new TokenStream API"!

Uwe

-----
Uwe Schindler
H.-H.-Meier-Allee 63, D-28213 Bremen
http://www.thetaphi.de
eMail: uwe@thetaphi.de


> -----Original Message-----
> From: Karthik K [mailto:karthikkatooru@gmail.com]
> Sent: Sunday, September 12, 2010 7:12 AM
> To: java-user@lucene.apache.org
> Subject: iterate through tokens in standardtokenizer
> 
> Hi,
> I am trying to use standardTokenizer in a non-lucene project to generate
> tokens. The previous versions i used supported token.next , getToken to
iterate
> over and retrieve the tokens continuously. 3.0.2 doesnt have that and i
cant
> figure out how to iterate. Can get number of tokens with increment token,
but
> cant get the exact terms. Is this the right place to ask?
> 
> Thanks


---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


Mime
View raw message