lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Karl Wettin (JIRA)" <j...@apache.org>
Subject [jira] Commented: (LUCENE-786) Extended javadocs in spellchecker
Date Sat, 03 Mar 2007 10:56:50 GMT

    [ https://issues.apache.org/jira/browse/LUCENE-786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12477607
] 

Karl Wettin commented on LUCENE-786:
------------------------------------


It might be noteworthy that the spell checker will gather numSug * 10 hits from the a priori
corpus. I suppose that number (10) was something the original author came up with when testing.
In most cases it is seems to be good enough. In my refactor I've introduced a method parameter
for the factor. This is probably a better looking solution than telling the user to increase
numSug, as numSug saves a few clock ticks when not adding a suggestion to the priority list.

The javadocs should probaly state something like that instead.


> Extended javadocs in spellchecker
> ---------------------------------
>
>                 Key: LUCENE-786
>                 URL: https://issues.apache.org/jira/browse/LUCENE-786
>             Project: Lucene - Java
>          Issue Type: Improvement
>          Components: Javadocs
>    Affects Versions: 2.0.0
>            Reporter: Karl Wettin
>         Assigned To: Otis Gospodnetic
>            Priority: Trivial
>         Attachments: spellcheck_javadocs.diff
>
>
> Added some javadocs that explains why the spellchecker does not work as one might expect
it to.
> http://www.nabble.com/SpellChecker%3A%3AsuggestSimilar%28%29-Question-tf3118660.html#a8640395
> > Without having looked at the code for a long time, I think the problem is what the
> > lucene scoring consider to be best. First the grams are searched, resulting in a
number
> > of hits. Then the edit-distance is calculated on each hit. "Genetics" is appearently
the
> > third most similar hit according to Lucene, but the best according to Levenshtein.
> >
> > I.e. Lucene does not use edit-distance as similarity. You need to get a bunch of
best hits
> > in order to find the one with the smallest edit-distance.
> I took a look at the code, and my assessment seems to be right.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


Mime
View raw message