lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Lorenzo Viscanti <lorenzo.visca...@gmail.com>
Subject StandardTokenizer
Date Tue, 27 Sep 2005 14:02:23 GMT
Hi, I'm trying to modify the StandardTokenizer, in order to get to get a
good tokenization for my needs.
Basically I would like to separate two tokens when I find an apostrophe. I
think I should modify the StandardTokenizer.jj file to do that, but I'm in
trouble while changing the grammar. Can someone help me with the right
syntax?
Thanks,
Lorenzo

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message