lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chris Lu" <chris...@gmail.com>
Subject Re: slow FieldCacheImpl.createValue
Date Tue, 20 May 2008 18:11:43 GMT
This should have a great boost to performance. Any plan to merge it into the
main brance instead of patch?

-- 
Chris Lu
-------------------------
Instant Scalable Full-Text Search On Any Database/Application
site: http://www.dbsight.net
demo: http://search.dbsight.com
Lucene Database Search in 3 minutes:
http://wiki.dbsight.com/index.php?title=Create_Lucene_Database_Search_in_3_minutes
DBSight customer, a shopping comparison site, (anonymous per request) got
2.6 Million Euro funding!

On Tue, May 20, 2008 at 7:37 AM, Jason Rutherglen <
jason.rutherglen@gmail.com> wrote:

> https://issues.apache.org/jira/browse/LUCENE-1278 solves this problem
>
> On Tue, May 20, 2008 at 1:32 AM, Anshum <anshumg@gmail.com> wrote:
>
> > Hey Alex,
> > I guess you haven't tried warming up the engine before putting it to use.
> > Though one of the simpler implementation, you could try warming up the
> > engine first by sending a few searches and then put it to use (put it
> into
> > the serving machine loop). You could also do a little bit of
> preprocessing
> > while initializing the daemon rather than waiting for the search to hit
> it.
> > I hope I understood the problem correctly here, else would have to look
> > into
> > it.
> >
> > --
> > Anshum
> >
> > 2008/5/20 Alex <chy1013m1@hotmail.com>:
> >
> > > hi,
> > > I have a ValueSourceQuery that makes use of a stored field. The field
> > > contains roughly 27.27 million untokenized terms.
> > > The average length of each term is 8 digits.
> > > The first search always takes around 5 minutes, and it is due to the
> > > createValue function in the FieldCacheImpl.
> > > The search is executed on a RAID5 disk array of 15k rpm.
> > >
> > >
> > > any hints as to make the fieldcache createvalue faster ? I have tried a
> > > bigger cache size for BufferedIndexReader (8kb or more) ,
> > > but the time it took for createValue to execute is still in the realm
> of
> > 4,
> > > 5 minutes.
> > >
> > >
> > > thanks
> > >
> > > _________________________________________________________________
> > > 5 GB 超大容量 、創新便捷、安全防護垃圾郵件和病毒 — 立即升級
Windows Live Hotmail
> > > http://mail.live.com
> > >
> >
> >
> >
> > --
> > --
> > The facts expressed here belong to everybody, the opinions to me.
> > The distinction is yours to draw............
> >
>
Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message