lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Yonik Seeley <>
Subject Re: who clears attributes?
Date Mon, 10 Aug 2009 17:42:12 GMT
Thinking through this a little more, I don't see an alternative to the
tokenizer clearing all attributes at the start of incrementToken().

Consider a DefaultPayloadTokenFilter that only sets a payload if one
isn't already set - it's clear that this filter can't clear the
payload attribute, so it must be cleared by the head of the chain -
the tokenizer.  Right?


To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message