lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Li Li <fancye...@gmail.com>
Subject how to reuse a tokenStream?
Date Fri, 28 May 2010 04:52:06 GMT
I want to analyzer a text twice so that I can get some statistic
information from this text
                                TokenStream tokenStream=null;
		Analyzer wa=new WhitespaceAnalyzer();
		try {
			tokenStream = wa.reusableTokenStream(fieldName, reader);
			while(tokenStream.incrementToken()){
				//do something
			}
		} catch (IOException e1) {
			e1.printStackTrace();
		}

		try {
                                                tokenStream.reset();
			//tokenStream = wa.reusableTokenStream(fieldName, reader);
			while(tokenStream.incrementToken()){
                                                                //not here
				System.out.println("resuable");

			}
		} catch (IOException e) {
			// TODO Auto-generated catch block
			e.printStackTrace();
		}

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


Mime
View raw message