lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Michael McCandless <>
Subject Re: FST Builder pruning
Date Fri, 15 Nov 2013 17:47:39 GMT
When you turn on pruning, FST Builder will just remove nodes that
don't have a high enough count of input terms traversing through them.
 E.g. if minSuffixCount1 is 100 then only FST nodes that see >= 100
input terms coming through them, are preserved.

You can use this to build a prefix trie instead of the full FST.

Creating a custom tail freezer is very expert: it lets you implement
arbitrary logic on which nodes are pruned or not.

Mike McCandless

On Fri, Nov 15, 2013 at 12:16 PM, Ravikumar Govindarajan
<> wrote:
> I was trying to understand some logic in Builder class of FST.
> The method freezeTail() looks quite hairy. I gather that there is an some
> logic for pruning a node or compiling it.
> What exactly is pruning a node? An example of it will be really really
> helpful
> --
> Ravi

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message