lucene-general mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From ayyanar <ayyanar.aswatha...@aspiresys.com>
Subject Tokenizer Question
Date Mon, 05 Jan 2009 17:23:35 GMT

I need a tokenizer that tokenizes a keyword as follows: Consider an example
"President day" - this should be tokenized as "President day", "President",
"Day"
This seems to be a functionality of a keyword tokenizer and whitespace
tokenizer
Do we have any tokenizer that does this job or we need to write a custom
one?

-- 
View this message in context: http://www.nabble.com/Tokenizer-Question-tp21295325p21295325.html
Sent from the Lucene - General mailing list archive at Nabble.com.


Mime
View raw message