lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "James Dyer (JIRA)" <>
Subject [jira] [Updated] (SOLR-2993) Integrate WordBreakSpellChecker with Solr
Date Fri, 01 Jun 2012 20:57:23 GMT


James Dyer updated SOLR-2993:

    Attachment: SOLR-2993.patch

Here is a new patch that can better handle collations involving mixed required/prohibited/optional
terms and also boolean operators (AND/OR/NOT).

When combining words, we do not want to combine an optional term with a prohibited one, etc.
 We also do not want to combine words that belong to different boolean clauses or those that
were "NOT"ed to one another.

Likewise, when splitting a term into multiples, we want to ensure all the resulting terms
are required if the original one was required, etc.  Also, if the query contains boolean operators
(AND/OR/NOT), this version ANDs the split terms together.

In the case of Boolean operators, SpellingQueryConverter can only make a guess as to the best
action.  It doesn't know the actual query parser used, the default "q.op" or "mm" setting,
etc.  All this does is make a reasonable guess as to the best way to re-write the query if
corrections involved combining and/or splitting words.

See WordBreakSpellCheckerTest#testCollate and SpellingQueryConverterTest#testRequiredOrProhibitedFlags
for examples of how this works.

Unless there are other issues, I plan to commit this in a few days.
> Integrate WordBreakSpellChecker with Solr
> -----------------------------------------
>                 Key: SOLR-2993
>                 URL:
>             Project: Solr
>          Issue Type: Improvement
>          Components: spellchecker
>    Affects Versions: 4.0
>            Reporter: James Dyer
>            Assignee: James Dyer
>            Priority: Minor
>             Fix For: 4.0, 5.0
>         Attachments: SOLR-2993.patch, SOLR-2993.patch, SOLR-2993.patch, SOLR-2993.patch
> A SpellCheckComponent enhancement, leveraging the WordBreakSpellChecker from LUCENE-3523:
> - Detect spelling errors resulting from misplaced whitespace without the use of shingle-based
> - Seamlessly integrate word-break suggestions with single-word spelling corrections from
the existing FileBased-, IndexBased- or Direct- spell checkers.  
> - Provide collation support for word-break errors including cases where the user has
a mix of single-word spelling errors and word-break errors in the same query.  
> - Provide shard support.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:!default.jspa
For more information on JIRA, see:


To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message