lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ganesh" <>
Subject Re: best practice: 1.4 billions documents
Date Mon, 29 Nov 2010 09:25:10 GMT
I am using ParallelMultiSearcher and querying more than 50 shards. I get wrong results for
query A NOT B. I am getting correct results if i query A -B. 
I am also getting correct results for wildcard and fuzzy.

What is the solution? I need to use IndexSearcher with MultiReader?


----- Original Message ----- 
From: "Robert Muir" <>
To: <>
Sent: Saturday, November 27, 2010 1:28 AM
Subject: Re: best practice: 1.4 billions documents

> On Fri, Nov 26, 2010 at 12:49 PM, Uwe Schindler <> wrote:
>> This is the problem for Fuzzy: each searcher expands the fuzzy query to a
>> different Boolean Query and so the scores are not comparable - MultiSearcher
>> (but not Solr) tries to combine the resulting rewritten queries into one
>> query, so every searcher has the same query.
> The problem is not actually any issue with FuzzyQuery, it is the
> Query.combine() with any Boolean rewrite... including AUTO as i
> mentioned earlier in this thread!
> AUTO starts out building a boolean rewrite... if certain magical
> conditions are hit (exceeds certain number of terms, or certain DF),
> then it switches over to a Filter.
> So, for example AUTO proclaims it will never hit boolean maxclauses
> exceeded exception, but it can (imagine multisearcher with 5
> searchers, it expands to 250 each, but then after combine() this is >
> 1024).
> In my opinion Query.combine() is completely broken, and i don't see
> how it can really be fixed to work with arbitrary query structures
> since a query might rewrite() differently on the different searchers.
> ---------------------------------------------------------------------
> To unsubscribe, e-mail:
> For additional commands, e-mail:
Send free SMS to your Friends on Mobile from your Yahoo! Messenger. Download Now!

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message