lucene-general mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From vempap <>
Subject StandardTokenizer generation from JFlex grammar
Date Thu, 04 Oct 2012 23:42:44 GMT

  I'm trying to generate the standard tokenizer again using the jflex
specification (StandardTokenizerImpl.jflex) but I'm not able to do so due to
some errors (I would like to create my own jflex file using the standard
tokenizer which is why I'm trying to first generate using that to get a hang
of things).

I'm using jflex 1.4.3 and I ran into the following error:

Error in file "<filename>" (line 64): 
Syntax error.
HangulEx       = (!(!\p{Script:Hangul}|!\p{WB:ALetter})) ({Format} |

Also, I tried installing an eclipse plugin from which I thought would provide
options similar to JavaCC ( through
which we can generate classes within eclipse - but had a hard luck.

Any help would be very helpful.


View this message in context:
Sent from the Lucene - General mailing list archive at

View raw message