lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mihai Caraman <caraman.mi...@gmail.com>
Subject Re: Performance question
Date Thu, 14 Jul 2011 12:45:28 GMT
Thank you for the reply, if you need more info to understand the question,
I'll try to be as prompt as possible.

> -if i search on last week's index and the individual index (this needs to
be
> opened at search request!?) will it be faster than using a single huge
index
> for all groups, for all weeks?

Searches will be made on only one group at a time(disjoint groups of
documents). So for very large groups, the old documents will have they're
own index. I'm hopping that this shortens the work load on a search by not
having to skip other groups while searching for large quantities of old
documents.  In other words, I won't be needing a filter for the group needed
to be searched, this being the filter with most hits.


  Storing all docs from search results on a
> massive index doesn't sound a very clever idea.
>
> It's a necessary step because i need to group results by they're date, so
I'm only storing doc-id's and retrieving they're date field.

>
> > I understood that Tweeter submitted their code on realTime architecture
> to
> > lucene, can i get my hands on that ?
>
> No idea.
>
>
> "... we’re planning on contributing all these changes back to Lucene; some
of which have already made it into Lucene’s trunk and its new realtime
branch." Read more<http://engineering.twitter.com/2010/10/twitters-new-search-architecture.html>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message