lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andrew Boyd <andrew.b...@mindspring.com>
Subject Re: Lucene and numerical fields search
Date Tue, 19 Jul 2005 14:15:39 GMT
I second the motion.  It sounds like a good solution to TooManyClauses exception.

-----Original Message-----
From: Otis Gospodnetic <otis_gospodnetic@yahoo.com>
Sent: Jul 16, 2005 5:59 PM
To: java-user@lucene.apache.org, Ray Tsang <saturnism@gmail.com>
Subject: Re: Lucene and numerical fields search

Hi Ray,

If you can share your BitSetQuery and QP modifications, feel free to
suggest them for inclusion to the core or contrib (by attaching them to
a new entry in Bugzilla).

Otis


--- Ray Tsang <saturnism@gmail.com> wrote:

> It seems TooManyClauses is a potential problem for any query that
> expands to a series of OR'ed boolean queries (PrefixQuery,
> WildcardQuery, RangeQuery...).  If the max was set too high, the
> inefficiency would make the search unsable.
> 
> I kind of worked around this by creating a BitSetQuery, and extended
> PrefixQuery and WildcardQuery so that they rewrite to BitSetQuery. 
> This at least made both queries usable on a large index (~40mil
> documents) with acceptable speed, without the use of filters.  I also
> extended QueryParser so it creates the new PrefixQuery and the new
> WildcardQuery instead of the ones provided by the distribution.
> 
> Ray
> 
> On 7/12/05, Paul.Illingworth@saaconsultants.com
> <Paul.Illingworth@saaconsultants.com> wrote:
> > 
> > 
> > 
> > 
> > 
> > Hi Mickaël,
> > 
> > Take a look at the org.apache.lucene.search.DateFilter class that
> comes
> > with Lucene. This does date range filtering (I am using a modified
> version
> > of this class for filtering my date format). It should be
> relatively
> > strightforward to modify this for filtering numeric ranges. If your
> numbers
> > are stored as zero padded Strings then you should be able to leave
> the
> > bits() method as is otherwise you might have to put some String to
> number
> > conversion in there somewhere.
> > 
> > Regards
> > 
> > Paul I
> > 
> > 
> > 
> >              Rifflard Mickaël
> >              <Mickael.Rifflard
> >              @atosorigin.com>                                      
>     To
> >                                       
> <java-user@lucene.apache.org>
> >              12/07/2005 09:31                                      
>     cc
> > 
> >                                                                   
> Subject
> >              Please respond to         RE: Lucene and numerical
> fields
> >              java-user@lucene.         search
> >                 apache.org
> > 
> > 
> > 
> > 
> > 
> > 
> > 
> > 
> > 
> > Hi Paul,
> > 
> > I have seen Filter feature and search how to use it to solve my
> problem
> >
> ---------------------------------------------------------------------
> > To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> > For additional commands, e-mail: java-user-help@lucene.apache.org
> > 
> >
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
> 
> 


---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


Mime
View raw message