lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Chris Hostetter <>
Subject Re: tokenize after filters
Date Thu, 12 Nov 2009 19:32:04 GMT
: ex: "A + W Root Beer"
: the field uses a keyword tokenizer to keep the string together, then
: it will get converted to "aw root beer" by a custom filter ive made, i
: now want to split that up into 3 tokens (aw, root, beer), but seems

TokenFilter's can produce more tokens then they consume ... so your custom 
TOkenFilter can split the single token "aw root beer" into three tokens if 
you want it to.  (this is how WordDelimiterFilter and SYnonymFilter work)


View raw message