lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dawid Weiss (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SOLR-2378) FST-based Lookup (suggestions) for prefix matches.
Date Thu, 14 Apr 2011 19:16:05 GMT

    [ https://issues.apache.org/jira/browse/SOLR-2378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13019991#comment-13019991
] 

Dawid Weiss commented on SOLR-2378:
-----------------------------------

We could... after all when 4.0 sees the light of day backwards compatibility does not need
to be (strictly) enforced, right? I would love somebody who actually uses this piece of functionality
to test it in a realistic setting first though. If nothing else, this would at least tell
us if any performance gain is visible at all (I'm guessing the HTTP stack will be the bottleneck
before we can see any differences between all the implemented methods). The big drop in RAM
usage should be visible right away, so this is a bonus.

> FST-based Lookup (suggestions) for prefix matches.
> --------------------------------------------------
>
>                 Key: SOLR-2378
>                 URL: https://issues.apache.org/jira/browse/SOLR-2378
>             Project: Solr
>          Issue Type: New Feature
>          Components: spellchecker
>            Reporter: Dawid Weiss
>            Assignee: Dawid Weiss
>              Labels: lookup, prefix
>             Fix For: 4.0
>
>         Attachments: SOLR-2378.patch
>
>
> Implement a subclass of Lookup based on finite state automata/ transducers (Lucene FST
package). This issue is for implementing a relatively basic prefix matcher, we will handle
infixes and other types of input matches gradually. Impl. phases:
> - -write a DFA based suggester effectively identical to ternary tree based solution right
now,-
> - -baseline benchmark against tern. tree (memory consumption, rebuilding speed, indexing
speed; reuse Andrzej's benchmark code)-
> - -modify DFA to encode term weights directly in the automaton (optimize for onlyMostPopular
case)-
> - -benchmark again-
> - -benchmark again-
> - -modify the tutorial on the wiki- [http://wiki.apache.org/solr/Suggester]

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message