lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Karl Wettin (JIRA)" <>
Subject [jira] Commented: (LUCENE-786) Extended javadocs in spellchecker
Date Sat, 03 Mar 2007 10:56:50 GMT


Karl Wettin commented on LUCENE-786:

It might be noteworthy that the spell checker will gather numSug * 10 hits from the a priori
corpus. I suppose that number (10) was something the original author came up with when testing.
In most cases it is seems to be good enough. In my refactor I've introduced a method parameter
for the factor. This is probably a better looking solution than telling the user to increase
numSug, as numSug saves a few clock ticks when not adding a suggestion to the priority list.

The javadocs should probaly state something like that instead.

> Extended javadocs in spellchecker
> ---------------------------------
>                 Key: LUCENE-786
>                 URL:
>             Project: Lucene - Java
>          Issue Type: Improvement
>          Components: Javadocs
>    Affects Versions: 2.0.0
>            Reporter: Karl Wettin
>         Assigned To: Otis Gospodnetic
>            Priority: Trivial
>         Attachments: spellcheck_javadocs.diff
> Added some javadocs that explains why the spellchecker does not work as one might expect
it to.
> > Without having looked at the code for a long time, I think the problem is what the
> > lucene scoring consider to be best. First the grams are searched, resulting in a
> > of hits. Then the edit-distance is calculated on each hit. "Genetics" is appearently
> > third most similar hit according to Lucene, but the best according to Levenshtein.
> >
> > I.e. Lucene does not use edit-distance as similarity. You need to get a bunch of
best hits
> > in order to find the one with the smallest edit-distance.
> I took a look at the code, and my assessment seems to be right.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message