lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From JONATHAN PACE <jmp...@fedex.com>
Subject Re: Datefiltering performance issues
Date Fri, 21 Jun 2002 21:07:30 GMT
I have seen the same DateFilter performance issues with a 1.3 million 
document index using JMeter benchmarking on the 1.2 final release.  
RangeQuery seems to take 5-10 times as long to return results.

Aside from that Lucene performance stomps our Verity install.

--jon

Jonathan Pace
Sr Programmer/Analyst
FedEx Services
60 FedEx Pkwy
1st Floor Horiz
Collierville, AR 38017


----- Original Message -----
From: Sylvain Puccianti <spuccianti@yahoo.fr>
Date: Friday, June 21, 2002 12:35 pm
Subject: Re: Datefiltering performance issues

> Thanks for the quick answer !
> I've just downloaded the 1.2 release jar, and my test 
> gives  me the same results. The more threads I've got,
> the slower Datefiltering gets (performance degradation
> is almost exponential).
> I tried to use the RangeQuery, as advised by Scott
> Ganyo, but it does not work very well. RangeQuery
> creates a TermQuery for each term within lowerTerm and
> higherTerm. If my range is too high, as I've got
> thoushands of documents, it just blows up memory...
> Is there any way to avoid sharing the TermInfosReader
> between all threads when creating the Bitset, or
> somehow avoid synchronizing the get method (if it is
> actually the bottleneck here) ?
> 
> Thanks,
> 
> Sylvain
> 
> --- Doug Cutting <cutting@lucene.com> a écrit : > What
> version of Lucene are you using?  There was a
> > patch made in January 
> > to address multi-threaded performance of DateFilter.
> > 
> > Doug
> > 
> > 
> > --
> > To unsubscribe, e-mail:  
> > <mailto:lucene-dev-unsubscribe@jakarta.apache.org>
> > For additional commands, e-mail:
> > <mailto:lucene-dev-help@jakarta.apache.org>
> >  
> 
> ___________________________________________________________
> Do You Yahoo!? -- Une adresse @yahoo.fr gratuite et en français !
> Yahoo! Mail : http://fr.mail.yahoo.com
> 
> --
> To unsubscribe, e-mail:   <mailto:lucene-dev-
> unsubscribe@jakarta.apache.org>For additional commands, e-mail: 
> <mailto:lucene-dev-help@jakarta.apache.org>
> 
> 


Mime
View raw message