lucy-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew S. Townley" <...@atownley.org>
Subject Re: [lucy-dev] RegexTokenizer
Date Tue, 08 Mar 2011 18:02:29 GMT

On 8 Mar 2011, at 5:40 PM, David E. Wheeler wrote:

> On Mar 8, 2011, at 9:36 AM, Marvin Humphrey wrote:
> 
>> Greets,
>> 
>> Right now, Lucy only has one tokenizer-style Analyzer subclass:
>> Lucy::Analysis::Tokenizer, which is regex based.  
>> 
>> At some point, I expect we will have other tokenizer classes which don't use a
>> regex engine, so I think it would be best to reserve the name "Tokenizer" for
>> future use and rename the current Tokenizer to "RegexTokenizer".
> 
> Lucy::Tokenizer::Regex please!

Yes.  That makes more sense.

--
Andrew S. Townley <ast@atownley.org>
http://atownley.org


Mime
View raw message