lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harald Kirsch <>
Subject Re: reuse of TokenStream
Date Fri, 18 Feb 2005 16:04:06 GMT
On Fri, Feb 18, 2005 at 10:43:07AM -0500, Erik Hatcher wrote:
> I'm confused on how you're reusing a TokenStream object.  General  
> Lucene usage would not involve a developer dealing with it directly.   

Why not? The IndexWriter wants to tokenize a field, so it calls my
Analyzer to get a custom made Tokenizer or TokenStream object for the
given field. Since setting up the TokenStream needs some work to be
done, I rather not repeat this work for every document to be indexed.


Harald Kirsch | | +44 (0) 1223/49-2593
BioMed Information Extraction:

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message