lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Yonik Seeley <>
Subject Re: max number of documents
Date Thu, 11 Aug 2005 03:55:33 GMT
I think it would be 2 billion.  There are many places that woudn't
like the overflow to negative docids I think...

We have indexes up to 200M documents, so 1/10th the max.
64 bit ids are definitely something to think about for the near future.

> Who's got Lucene indexes nearing the maximum integer value?   I'm
> seriously curious.  That's over 4 billion documents.
> As for scaling - at that point I recommend checking out Nutch's
> architecture, especially the new MapReduce branch.  It's made for
> this sort of big time scalability.
>      Erik

I'm still trying to grok MapReduce...


To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message