lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Lorenzo Viscanti <>
Subject StandardTokenizer
Date Tue, 27 Sep 2005 14:02:23 GMT
Hi, I'm trying to modify the StandardTokenizer, in order to get to get a
good tokenization for my needs.
Basically I would like to separate two tokens when I find an apostrophe. I
think I should modify the StandardTokenizer.jj file to do that, but I'm in
trouble while changing the grammar. Can someone help me with the right

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message