lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ahmet Arslan <>
Subject Re: Two-pass TokenFilter
Date Sun, 24 Aug 2014 11:50:25 GMT

Can you elaborate more, what do you mean by "I need to know all tokens in advance."


On Wednesday, August 20, 2014 6:48 PM, Christian Beil <> wrote:
Hey guys,

I need a TokenFilter that filters some tokens like the FilteringTokenFilter.
The problem is, in order to do the filtering I need to know all tokens in

I thought I'll adapt the CachingTokenFilter in order to collect all tokens
in the first pass.
In the second pass it can use this information to filter the tokens.

Or is there a better solution to do this?


To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message