Mailing-List: contact solr-dev-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: solr-dev@lucene.apache.org
Message-ID: <772834539.1248991814881.JavaMail.jira@brutus>
Date: Thu, 30 Jul 2009 15:10:14 -0700 (PDT)
From: "Shalin Shekhar Mangar (JIRA)" <jira@apache.org>
To: solr-dev@lucene.apache.org
Subject: [jira] Commented: (SOLR-908) Port of Nutch  CommonGrams filter to
 Solr
In-Reply-To: <366731999.1229027804389.JavaMail.jira@brutus>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


    [ https://issues.apache.org/jira/browse/SOLR-908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12737327#action_12737327 ] 

Shalin Shekhar Mangar commented on SOLR-908:
--------------------------------------------

{quote}
BTW you asked >>Can we change this to be a fix for 1.4?
I'd love to, but don't the committers make that decision? How do we do that?
{quote}

Considering that:
# The issue is old and a patch has been here in one form or another since April
# We have ample time before 1.4 release

I see no reason why it can't be committed for 1.4. Otis, since you have looked at this in the past, will you take this up? Or, I can try to have a look this weekend.


> Port of Nutch  CommonGrams filter to Solr
> -----------------------------------------
>
>                 Key: SOLR-908
>                 URL: https://issues.apache.org/jira/browse/SOLR-908
>             Project: Solr
>          Issue Type: Wish
>          Components: Analysis
>            Reporter: Tom Burton-West
>            Priority: Minor
>         Attachments: CommonGramsPort.zip, SOLR-908.patch, SOLR-908.patch, SOLR-908.patch, SOLR-908.patch
>
>
> Phrase queries containing common words are extremely slow.  We are reluctant to just use stop words due to various problems with false hits and some things becoming impossible to search with stop words turned on. (For example "to be or not to be", "the who", "man in the moon" vs "man on the moon" etc.)  
> Several postings regarding slow phrase queries have suggested using the approach used by Nutch.  Perhaps someone with more Java/Solr experience might take this on.
> It should be possible to port the Nutch CommonGrams code to Solr  and create a suitable Solr FilterFactory so that it could be used in Solr by listing it in the Solr schema.xml.
> "Construct n-grams for frequently occuring terms and phrases while indexing. Optimize phrase queries to use the n-grams. Single terms are still indexed too, with n-grams overlaid."
> http://lucene.apache.org/nutch/apidocs-0.8.x/org/apache/nutch/analysis/CommonGrams.html

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.