lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From John McNally <jmcna...@collab.net>
Subject Re: cvs commit: jakarta-lucene/src/java/org/apache/lucene/analysis/standard StandardTokenizer.java StandardTokenizer.jj StandardTokenizerConstants.java StandardTokenizerTokenManager.java
Date Tue, 23 Dec 2003 19:43:13 GMT
my simple tests with some japanese text shows this to be a major
improvement.  
thank you,
john mcnally

On Mon, 2003-12-22 at 14:12, cutting@apache.org wrote:
> cutting     2003/12/22 14:12:24
> 
>   Modified:    .        CHANGES.txt
>                src/java/org/apache/lucene/analysis/standard
>                         StandardTokenizer.java StandardTokenizer.jj
>                         StandardTokenizerConstants.java
>                         StandardTokenizerTokenManager.java
>   Log:
>   Fix StandardTokenizer's handling of CJK characters.
>   



---------------------------------------------------------------------
To unsubscribe, e-mail: lucene-dev-unsubscribe@jakarta.apache.org
For additional commands, e-mail: lucene-dev-help@jakarta.apache.org


Mime
View raw message