lucene-java-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From gsing...@apache.org
Subject svn commit: r612244 - /lucene/java/trunk/contrib/wikipedia/src/java/org/apache/lucene/wikipedia/analysis/WikipediaTokenizer.java
Date Tue, 15 Jan 2008 22:01:23 GMT
Author: gsingers
Date: Tue Jan 15 14:01:21 2008
New Revision: 612244

URL: http://svn.apache.org/viewvc?rev=612244&view=rev
Log:
LUCENE-1135.  Added Javadoc marking the WikipediaTokenizer as experimental

Modified:
    lucene/java/trunk/contrib/wikipedia/src/java/org/apache/lucene/wikipedia/analysis/WikipediaTokenizer.java

Modified: lucene/java/trunk/contrib/wikipedia/src/java/org/apache/lucene/wikipedia/analysis/WikipediaTokenizer.java
URL: http://svn.apache.org/viewvc/lucene/java/trunk/contrib/wikipedia/src/java/org/apache/lucene/wikipedia/analysis/WikipediaTokenizer.java?rev=612244&r1=612243&r2=612244&view=diff
==============================================================================
--- lucene/java/trunk/contrib/wikipedia/src/java/org/apache/lucene/wikipedia/analysis/WikipediaTokenizer.java
(original)
+++ lucene/java/trunk/contrib/wikipedia/src/java/org/apache/lucene/wikipedia/analysis/WikipediaTokenizer.java
Tue Jan 15 14:01:21 2008
@@ -20,14 +20,17 @@
 import org.apache.lucene.analysis.Token;
 import org.apache.lucene.analysis.Tokenizer;
 
-import java.io.Reader;
 import java.io.IOException;
+import java.io.Reader;
 
 
 /**
  * Extension of StandardTokenizer that is aware of Wikipedia syntax.  It is based off of
the
  * Wikipedia tutorial available at http://en.wikipedia.org/wiki/Wikipedia:Tutorial, but it
may not be complete.
  *
+ * <p/>
+ * EXPERIMENTAL !!!!!!!!!
+ * NOTE: This Tokenizer is considered experimental and the grammar is subject to change in
the trunk and in follow up releases.
  *
  **/
 public class WikipediaTokenizer extends Tokenizer {



Mime
View raw message