lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Valentin Popov <valentin...@gmail.com>
Subject Re: 500 millions document for loop.
Date Thu, 21 Apr 2016 13:44:03 GMT
Chris , hello. 

Thank got the tip, but could you explain how can I use it? 

Regards,
Valentin. 
> On 16 нояб. 2015 г., at 0:42, Chris Hostetter <hossman_lucene@fucit.org> wrote:
> 
> 
> : 			public void collect(int docID) throws IOException {
> : 				Document doc = indexSearcher.doc(docID, loadFields);
> : 				found.found(doc);
> : 			}
> 
> Based on your description of the calculation you are doing on all of these 
> docs, you will probably find using DocValues on the "to" field and using 
> that in your calculations will be a lot faster then dealing with the 
> StoredFields...
> 
> : >>>>>> We have ~10 indexes for 500M documents, each document
> : >>>>>> has «archive date», and «to» address, one of our task
is
> : >>>>>> calculate statistics of «to» for last year. Right now we
are
> : >>>>>> using search archive_date:(current_date - 1 year) and paginate
> 
> 
> -Hoss
> http://www.lucidworks.com/
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org

Regards,
Valentin Popov





---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


Mime
View raw message