lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Yonik Seeley <ysee...@gmail.com>
Subject Re: max number of documents
Date Thu, 11 Aug 2005 03:55:33 GMT
I think it would be 2 billion.  There are many places that woudn't
like the overflow to negative docids I think...

We have indexes up to 200M documents, so 1/10th the max.
64 bit ids are definitely something to think about for the near future.

> Who's got Lucene indexes nearing the maximum integer value?   I'm
> seriously curious.  That's over 4 billion documents.
> 
> As for scaling - at that point I recommend checking out Nutch's
> architecture, especially the new MapReduce branch.  It's made for
> this sort of big time scalability.
> 
>      Erik

I'm still trying to grok MapReduce...

-Yonik

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


Mime
View raw message