lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yonik Seeley" <ysee...@gmail.com>
Subject Re: WordDelimiterFilter looses position increments of tokens
Date Tue, 04 Jul 2006 22:26:10 GMT
On 7/4/06, Eric Jain <Eric.Jain@isb-sib.ch> wrote:
> Just noticed that in the newTok method in the WordDelimiterFilter, the
> "position increment" of the token doesn't seem to be copied?

Your'e right, it does look possible that position info can be lost.
The fix probably isn't as simple as copying the position increment in
newTok()... the original increment should only be copied for the first
token generated.


-Yonik

Mime
View raw message