lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From ehatc...@apache.org
Subject cvs commit: jakarta-lucene-sandbox/contributions/analyzers/src/java/org/apache/lucene/analysis/cjk CJKTokenizer.java
Date Wed, 18 Aug 2004 10:38:07 GMT
ehatcher    2004/08/18 03:38:07

  Modified:    contributions/analyzers/src/java/org/apache/lucene/analysis/cjk
                        CJKTokenizer.java
  Added:       contributions/analyzers/src/java overview.html
  Log:
  quick fixes for javadoc warnings/errors
  
  Revision  Changes    Path
  1.1                  jakarta-lucene-sandbox/contributions/analyzers/src/java/overview.html
  
  Index: overview.html
  ===================================================================
  <html>
    <head>
      <title>Jakarta Lucene Sandbox Analyzers</title>
    </head>
    <body>
    </body>
  </html>
  
  
  1.4       +3 -5      jakarta-lucene-sandbox/contributions/analyzers/src/java/org/apache/lucene/analysis/cjk/CJKTokenizer.java
  
  Index: CJKTokenizer.java
  ===================================================================
  RCS file: /home/cvs/jakarta-lucene-sandbox/contributions/analyzers/src/java/org/apache/lucene/analysis/cjk/CJKTokenizer.java,v
  retrieving revision 1.3
  retrieving revision 1.4
  diff -u -r1.3 -r1.4
  --- CJKTokenizer.java	22 Jan 2004 20:54:47 -0000	1.3
  +++ CJKTokenizer.java	18 Aug 2004 10:38:07 -0000	1.4
  @@ -61,9 +61,8 @@
   
   
   /**
  - * <p>
    * CJKTokenizer was modified from StopTokenizer which does a decent job for
  - * most European languages. and it perferm other token method for double-byte
  + * most European languages. It performs other token methods for double-byte
    * Characters: the token will return at each two charactors with overlap match.<br>
    * Example: "java C1C2C3C4" will be segment to: "java" "C1C2" "C2C3" "C3C4" it
    * also need filter filter zero length token ""<br>
  @@ -71,7 +70,6 @@
    * for more info on Asia language(Chinese Japanese Korean) text segmentation:
    * please search  <a
    * href="http://www.google.com/search?q=word+chinese+segment">google</a>
  - * </p>
    *
    * @author Che, Dong
    */
  @@ -132,14 +130,14 @@
   
       /**
        * Returns the next token in the stream, or null at EOS.
  +     * See http://java.sun.com/j2se/1.3/docs/api/java/lang/Character.UnicodeBlock.html
  +     * for detail.
        *
        * @return Token
        *
        * @throws java.io.IOException - throw IOException when read error <br>
        *         hanppened in the InputStream
        *
  -     * @see "http://java.sun.com/j2se/1.3/docs/api/java/lang/Character.UnicodeBlock.html"
  -     *      for detail
        */
       public final Token next() throws java.io.IOException {
           /** how many character(s) has been stored in buffer */
  
  
  

---------------------------------------------------------------------
To unsubscribe, e-mail: lucene-dev-unsubscribe@jakarta.apache.org
For additional commands, e-mail: lucene-dev-help@jakarta.apache.org


Mime
View raw message