lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rafael C. de Almeida" <almeida...@gmail.com>
Subject Unique tokens analyzer
Date Tue, 14 Oct 2008 15:38:47 GMT
Hello,

Is there a analyzer that will tokenize the stream such that there's no  
repeated tokens in the stream? I have a keyword-field on my document,  
so if one keyword already appears on the list there's no point in  
having it shown again. Does it make sense having that analyzer? Or  
indexing repeated keywords on the same field shouldn't hurt  
performance or search quality in any way?

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


Mime
View raw message