lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jack Krupansky" <j...@basetechnology.com>
Subject Re: tokenizer in porterStemmer
Date Fri, 16 Nov 2012 14:45:15 GMT
A stemmer is a "token filter", so it can be applied to the output of 
whatever tokenizer you choose to use.

There is an example here:
http://lucene.apache.org/core/4_0_0/analyzers-common/org/apache/lucene/analysis/en/PorterStemFilter.html

class MyAnalyzer extends Analyzer {
  @Override
  protected TokenStreamComponents createComponents(String fieldName, Reader 
reader) {
    Tokenizer source = new LowerCaseTokenizer(version, reader);
    return new TokenStreamComponents(source, new PorterStemFilter(source));
  }
}

Next time, please use the java-user mailing list for usage questions about 
Lucene.

-- Jack Krupansky

-----Original Message----- 
From: Emiliana Suci
Sent: Friday, November 16, 2012 4:33 AM
To: dev@lucene.apache.org
Subject: tokenizer in porterStemmer

PorterStemmer using tokenizer which class in lucene??



--
View this message in context: 
http://lucene.472066.n3.nabble.com/tokenizer-in-porterStemmer-tp4020711.html
Sent from the Lucene - Java Developer mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org 


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message