lucene-solr-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Solr Wiki] Update of "AnalyzersTokenizersTokenFilters" by JanHoydahl
Date Sat, 24 Sep 2011 17:26:10 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Solr Wiki" for change notification.

The "AnalyzersTokenizersTokenFilters" page has been changed by JanHoydahl:
http://wiki.apache.org/solr/AnalyzersTokenizersTokenFilters?action=diff&rev1=125&rev2=126

Comment:
Updated Hunspell reference after commit of SOLR-2769

  There are four types of stemming strategies:
  
   * [[http://tartarus.org/~martin/PorterStemmer/|Porter]] or Reduction stemming — A transforming
algorithm that reduces any of the forms of a word such as "walks, walking, walked", to its
elemental root e.g., "walk". Porter stemming must be performed ''both'' at insertion time
and at query time.
-  * [[http://code.google.com/p/lucene-hunspell/|Lucene-Hunspell]] aims to provide features
such as stemming, decompounding, spellchecking, normalization, term expansion, etc. taking
advantage of the existing lexical resources already created and widely-used in projects like
!OpenOffice. This is still alpha-version but with an impressive list of supported languages
(See [[http://lucene-eurocon.org/sessions-track2-day2.html#5|this presentation]] for more)
+  * [[Hunspell]] provides stemming for 99 languages, taking advantage of the existing lexical
resources already created and widely-used in projects like !OpenOffice. The component will
later possible support decompounding, spellchecking, normalization, term expansion, etc. See
LanguageAnalysis for details.
   * Expansion stemming — Takes a root word and 'expands' it to all of its various forms
— can be used ''either'' at insertion time ''or'' at query time.  One way to approach this
is by using the [[#SynonymFilter|SynonymFilterFactory]]
   * [[AnalyzersTokenizersTokenFilters/Kstem|KStem]], an alternative to Porter for developers
looking for a less agressive stemmer.
  

Mime
View raw message