lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Koji Sekiguchi <k...@r.email.ne.jp>
Subject Re: Proposal for introducing CharFilter
Date Tue, 11 Nov 2008 23:33:29 GMT
 > This looks like a good idea, thanks!
 >
 > If a given Tokenizer does not need to do any character normalization 
(I would think most wouldn't) is there any added cost during 
tokenization with this change?

Thank you for your reply, Mike!
There is no added cost if Tokenizer doesn't need to call correctOffset().

Koji


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


Mime
View raw message