Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: java-user@lucene.apache.org
Received-SPF: pass (athena.apache.org: domain of erickerickson@gmail.com
 designates 209.85.216.48 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :content-type;
        b=N4jiUGL8qeRulacDFp3WwMDBzmFduJDh6Bugfm3JfXNT8tja1i5fGLrcSuk6akLB6x
         gQv06SBqbYYwy3SfHeB/4S1a+4rWpsi6qEDAvKOBHR0rV+k/yv7KhGIUTGBJitWH79WI
         Xw6LrWJwY/zSd5fIIDalblEHfocCcEsXxRHZE=
MIME-Version: 1.0
In-Reply-To: <1281749081591-1142517.post@n3.nabble.com>
References: <1281749081591-1142517.post@n3.nabble.com>
Date: Sat, 14 Aug 2010 07:09:22 -0400
Message-ID: <AANLkTinTduY6mjLigRVePS=N4Dbi0rua+XH_SNHnL4V5@mail.gmail.com>
Subject: Re: scalability limit in terms of numbers of large documents
From: Erick Erickson <erickerickson@gmail.com>
To: java-user@lucene.apache.org
Content-Type: multipart/alternative; boundary=000feaf9578dacb0ba048dc6a12e

--000feaf9578dacb0ba048dc6a12e
Content-Type: text/plain; charset=ISO-8859-1

As asked, that's really an unanswerable question. The math is pretty easy
in terms of running out of document IDs, but "searched quickly" depends
on too many variables.

I suspect, though, that long before you ran out of document IDs, you'd need
to shard your index, Have you looked at SOLR?

Best
Erick

On Fri, Aug 13, 2010 at 9:24 PM, andynuss <andrew_nuss@yahoo.com> wrote:

>
> Hi,
>
> Lets say that I am indexing large book documents broken into chapters.  A
> typical book that you buy at amazon.  What would be the approximate limit
> to
> the number of books that can be indexed slowly and searched quickly.  The
> search unit would be a chapter, so assume that a book is divided into 15-50
> chapters.  Any ideas?
>
> Andy
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/scalability-limit-in-terms-of-numbers-of-large-documents-tp1142517p1142517.html
> Sent from the Lucene - Java Users mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
>

--000feaf9578dacb0ba048dc6a12e--