lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Karel Tejnora <ka...@tejnora.cz>
Subject Re: StandardAnalyzer Problem with Apostrophes
Date Tue, 14 Nov 2006 21:05:32 GMT
The problem is in StandardTokenizer so Analyzer with method:

public TokenStream tokenStream(String fieldName, Reader reader) {
    TokenStream result = new LowerCaseTokenizer(reader);
    result = new StopFilter(result, stopSet);
    return result;
}

if you need everything standard analyzer does
 From StandardTokenizer.jj

remove token def.
176 token = <APOSTROPHE> |

than compile. l'aabb shall be recognized as <ALPHA> <ALPHA>


||

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


Mime
View raw message