incubator-lucy-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Peter Karman <pe...@peknet.com>
Subject Re: [lucy-dev] RegexTokenizer
Date Tue, 08 Mar 2011 18:42:30 GMT
David E. Wheeler wrote on 03/08/2011 11:40 AM:
> On Mar 8, 2011, at 9:36 AM, Marvin Humphrey wrote:
> 
>> Greets,
>>
>> Right now, Lucy only has one tokenizer-style Analyzer subclass:
>> Lucy::Analysis::Tokenizer, which is regex based.  
>>
>> At some point, I expect we will have other tokenizer classes which don't use a
>> regex engine, so I think it would be best to reserve the name "Tokenizer" for
>> future use and rename the current Tokenizer to "RegexTokenizer".
> 
> Lucy::Tokenizer::Regex please!
> 

+1

(
although, iirc there was some discussion awhile back about class naming
and depth vs breadth.

/me can recall neither the outcome nor the gist, and my finding-fu is
weak atm.
)

-- 
Peter Karman  .  http://peknet.com/  .  peter@peknet.com

Mime
View raw message