lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Grant Ingersoll (JIRA)" <j...@apache.org>
Subject [jira] Resolved: (LUCENE-494) Analyzer for preventing overload of search service by queries with common terms in large indexes
Date Thu, 07 Feb 2008 14:14:08 GMT

     [ https://issues.apache.org/jira/browse/LUCENE-494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Grant Ingersoll resolved LUCENE-494.
------------------------------------

       Resolution: Fixed
    Fix Version/s: 2.4

Committed, thanks Mark!

> Analyzer for preventing overload of search service by queries with common terms in large
indexes
> ------------------------------------------------------------------------------------------------
>
>                 Key: LUCENE-494
>                 URL: https://issues.apache.org/jira/browse/LUCENE-494
>             Project: Lucene - Java
>          Issue Type: New Feature
>          Components: Analysis
>    Affects Versions: 2.4
>            Reporter: Mark Harwood
>            Assignee: Grant Ingersoll
>            Priority: Minor
>             Fix For: 2.4
>
>         Attachments: QueryAutoStopWordAnalyzer.java, QueryAutoStopWordAnalyzerTest.java
>
>
> An analyzer used primarily at query time to wrap another analyzer and provide a layer
of protection
> which prevents very common words from being passed into queries. For very large indexes
the cost
> of reading TermDocs for a very common word can be  high. This analyzer was created after
experience with
> a 38 million doc index which had a term in around 50% of docs and was causing TermQueries
for 
> this term to take 2 seconds.
> Use the various "addStopWords" methods in this class to automate the identification and
addition of 
> stop words found in an already existing index.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


Mime
View raw message