lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From bhecht <>
Subject Implement a tokenizer
Date Mon, 21 May 2007 18:59:14 GMT

Hi there,

I was interested in changing the StandardTokenzier so it will not remove the
"+" (plus) sign from my stream.
Looking in the code and documentation, it reads: 

"If this tokenizer does not suit your application, please consider copying
this source code
directory to your project and maintaining your own grammar-based tokenizer."

I can't understand from this code where I should jump in, and do my change.
Can someone point me out to where I should look at in order perform my

Thanks in advanced
View this message in context:
Sent from the Lucene - Java Users mailing list archive at

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message