lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Erick Erickson <erickerick...@gmail.com>
Subject Re: Alternative way to simulate sorting without doing actual sort
Date Tue, 21 Jul 2009 13:59:49 GMT
Have you tried splitting your times into separate fields, perhaps one with
YYYYMMDD and another with HHMM, then do a primary sort on the YYYMMDD and
secondary on HHMM. That'll reduce your total unique values greatly and
should improve your memory consumption.
Best
Erick

On Tue, Jul 21, 2009 at 4:27 AM, Ganesh <emailgane@yahoo.co.in> wrote:

> Hello all
>
> I am sorting on datetime with minute resolution. It easily reaches the
> maximum heap size. I am having almost 100M records and it is using 1.5 GB. I
> am now in a situitation to stop sorting and to find some other alternative
> way.
>
> I tried adding document boost and field boost for date time. document boost
> alone is not working. document boost and field boost has impact on score.
> Search on datetime gives me the sorted datetime results but search on any
> other field didn't works.
>
> I am doing updates and it changes the doc id.. I want to get the results
> sorted by FIRST TIME inserted order. Updates should not disturb the results
> set. I think Solr has some facilities to get the list of recently added
> documents.
>
> Any ideas are greatly appreciated.
>
> Regards
> GaneshSend instant messages to your online friends
> http://in.messenger.yahoo.com
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message