lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sheng <sheng...@gmail.com>
Subject WhiteSpaceTokenizer
Date Fri, 15 Aug 2014 03:38:27 GMT
The length of token has to be shorter than 255, otherwise there will
be unpredictable behaviors for this tokenizer. I see 255 is set as a
private final in the src code, but there is no documentation to explicitly
address that. Can we either make that number configurable (if not an
option, I'd like to know why), or put some notes to its java doc? I had a
hard time to figure that out...

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message