lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Chris Hostetter <hossman_luc...@fucit.org>
Subject Re: Should analysis.jsp honor maxFieldLength
Date Thu, 26 Aug 2010 22:06:07 GMT

This can be dealt with in a lot of differnet ways in Solr -- even if 
Lucene removes all suppport for the IndexWriter.maxFieldLength, Solr can 
still support it by wrapping every analyzer with a LimitTokenCountFilter 
if that config option is used.  

we could concievable support having LimitTokenCountFilter added implicitly 
even if that option isn't used, via some syntax like you suggest -- but 
honestly i think it's better to just let the user declare it like any 
other filter -- that way it doesn't have any special semantics, and they 
can put it at the end (limit tokens) or at the begining (limit tokenz from 
the tokenizer, but allow more tokens to be added by synonyms, WDF, etc...)

: What about an option to override this on a per field-type and/or per 
: field basis. Then the global setting could still be default:


-Hoss

--
http://lucenerevolution.org/  ...  October 7-8, Boston
http://bit.ly/stump-hoss      ...  Stump The Chump!

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message