lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From newbieoflucene <shanghai2...@hotmail.com>
Subject Re: How to count categories?
Date Mon, 24 Sep 2007 01:40:36 GMT

I've searched for many times but not found the solution.
It's really a problem to me.

Thanks!


Erick Erickson wrote:
> 
> Also, search the mail archive for the word "faceting", this topic has
> been discussed many times, and there's quite a bit of information
> about this topic.
> 
> Best
> Erick
> 
> On 9/22/07, newbieoflucene <shanghai2k10@hotmail.com> wrote:
>>
>>
>> 2-3G index data with 20M records, and each record has 10 or more fields,
>> 3-5
>> fields are group fields, which I want to count them for returned results
>> after searching. These group fields contains about 1000 or more values.
>> It
>> means that I would count 1000 categories for each search.
>>
>> Due to the searched results number will be very big, so iterator each
>> record
>> with HitCollector that is too slow to count all of records (counting will
>> cost about 30 seconds)
>>
>> Unfortunately, If I use QueryFilter to query each category one by one and
>> save it to BitSet, but the number of category is about 1000, I've to
>> filter
>> it about 1000 times to count each category. It still consumed about 20
>> seconds.
>>
>> Is there any better way to count these categories faster and low memory?
>>
>> Any idea is appreciated!
>> --
>> View this message in context:
>> http://www.nabble.com/How-to-count-categories--tf4500720.html#a12835751
>> Sent from the Lucene - Java Users mailing list archive at Nabble.com.
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>
>>
> 
> 

-- 
View this message in context: http://www.nabble.com/How-to-count-categories--tf4500720.html#a12852707
Sent from the Lucene - Java Users mailing list archive at Nabble.com.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


Mime
View raw message