lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ganesh" <emailg...@yahoo.co.in>
Subject Re: best practice: 1.4 billions documents
Date Mon, 29 Nov 2010 09:25:10 GMT
I am using ParallelMultiSearcher and querying more than 50 shards. I get wrong results for
query A NOT B. I am getting correct results if i query A -B. 
I am also getting correct results for wildcard and fuzzy.

What is the solution? I need to use IndexSearcher with MultiReader?

Regards
Ganesh

----- Original Message ----- 
From: "Robert Muir" <rcmuir@gmail.com>
To: <java-user@lucene.apache.org>
Sent: Saturday, November 27, 2010 1:28 AM
Subject: Re: best practice: 1.4 billions documents


> On Fri, Nov 26, 2010 at 12:49 PM, Uwe Schindler <uwe@thetaphi.de> wrote:
>> This is the problem for Fuzzy: each searcher expands the fuzzy query to a
>> different Boolean Query and so the scores are not comparable - MultiSearcher
>> (but not Solr) tries to combine the resulting rewritten queries into one
>> query, so every searcher has the same query.
> 
> The problem is not actually any issue with FuzzyQuery, it is the
> Query.combine() with any Boolean rewrite... including AUTO as i
> mentioned earlier in this thread!
> 
> AUTO starts out building a boolean rewrite... if certain magical
> conditions are hit (exceeds certain number of terms, or certain DF),
> then it switches over to a Filter.
> 
> So, for example AUTO proclaims it will never hit boolean maxclauses
> exceeded exception, but it can (imagine multisearcher with 5
> searchers, it expands to 250 each, but then after combine() this is >
> 1024).
> 
> In my opinion Query.combine() is completely broken, and i don't see
> how it can really be fixed to work with arbitrary query structures
> since a query might rewrite() differently on the different searchers.
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
Send free SMS to your Friends on Mobile from your Yahoo! Messenger. Download Now! http://messenger.yahoo.com/download.php

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


Mime
View raw message