lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Erick Erickson" <erickerick...@gmail.com>
Subject Re: How to count categories?
Date Sun, 23 Sep 2007 13:41:15 GMT
Also, search the mail archive for the word "faceting", this topic has
been discussed many times, and there's quite a bit of information
about this topic.

Best
Erick

On 9/22/07, newbieoflucene <shanghai2k10@hotmail.com> wrote:
>
>
> 2-3G index data with 20M records, and each record has 10 or more fields,
> 3-5
> fields are group fields, which I want to count them for returned results
> after searching. These group fields contains about 1000 or more values. It
> means that I would count 1000 categories for each search.
>
> Due to the searched results number will be very big, so iterator each
> record
> with HitCollector that is too slow to count all of records (counting will
> cost about 30 seconds)
>
> Unfortunately, If I use QueryFilter to query each category one by one and
> save it to BitSet, but the number of category is about 1000, I've to
> filter
> it about 1000 times to count each category. It still consumed about 20
> seconds.
>
> Is there any better way to count these categories faster and low memory?
>
> Any idea is appreciated!
> --
> View this message in context:
> http://www.nabble.com/How-to-count-categories--tf4500720.html#a12835751
> Sent from the Lucene - Java Users mailing list archive at Nabble.com.
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message