Return-Path: Delivered-To: apmail-lucene-java-user-archive@www.apache.org Received: (qmail 92091 invoked from network); 13 Aug 2007 13:25:08 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 13 Aug 2007 13:25:08 -0000 Received: (qmail 25315 invoked by uid 500); 13 Aug 2007 13:25:01 -0000 Delivered-To: apmail-lucene-java-user-archive@lucene.apache.org Received: (qmail 24858 invoked by uid 500); 13 Aug 2007 13:24:59 -0000 Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: java-user@lucene.apache.org Delivered-To: mailing list java-user@lucene.apache.org Received: (qmail 24844 invoked by uid 99); 13 Aug 2007 13:24:59 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 13 Aug 2007 06:24:59 -0700 X-ASF-Spam-Status: No, hits=2.0 required=10.0 tests=HTML_MESSAGE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of erickerickson@gmail.com designates 209.85.134.188 as permitted sender) Received: from [209.85.134.188] (HELO mu-out-0910.google.com) (209.85.134.188) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 13 Aug 2007 13:24:55 +0000 Received: by mu-out-0910.google.com with SMTP id g7so1681516muf for ; Mon, 13 Aug 2007 06:24:34 -0700 (PDT) DKIM-Signature: a=rsa-sha1; c=relaxed/relaxed; d=gmail.com; s=beta; h=domainkey-signature:received:received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:references; b=NQO76pr7waDmCCggH6KTc9yZsmAFr/Al27jGOF8MUO7E736lmvZT0wqZnhMm5R4ihOb4tRov9ZaU4FouYCa4CXzmnBYuSIUbsvzMx9aimxL+t8GFs9c/Ivu381/Pr4xrfoJhM6m/Oo8ik/VgOMIFMq7utCs0OnqduIBVyhk/O+U= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:references; b=HElVdWDpHn4SSeO/UfkaQCvFvmnVywQKUdL5j/0M/jTVdp0ZEjppqIpEEZIXSmT3kcd5tiqJdspSoqKUe4BWAhPOdnK/ydVsOjxnAhguAxYUCDj/2G22bwT7j2ythXcKzILwNV6ghbE0RQFpWVG7RylT/8sKMYbomqDXoKZt7Y8= Received: by 10.82.127.14 with SMTP id z14mr8159304buc.1187011474072; Mon, 13 Aug 2007 06:24:34 -0700 (PDT) Received: by 10.82.167.3 with HTTP; Mon, 13 Aug 2007 06:24:34 -0700 (PDT) Message-ID: <359a92830708130624t7e679c59kf961822d7fb84bf4@mail.gmail.com> Date: Mon, 13 Aug 2007 09:24:34 -0400 From: "Erick Erickson" To: java-user@lucene.apache.org Subject: Re: Index file size limitation of 2GB Cc: mrrohitsaini@gmail.com In-Reply-To: <3cb8ef760708122230k1b3c8bb6h6785c04dabbe1f75@mail.gmail.com> MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_Part_26932_14752397.1187011474047" References: <3cb8ef760708122230k1b3c8bb6h6785c04dabbe1f75@mail.gmail.com> X-Virus-Checked: Checked by ClamAV on apache.org ------=_Part_26932_14752397.1187011474047 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline There is no *lucene* limitation of a 2GB index file. I've had no trouble with single indexes over 8G. If you're referring to this page... http://wiki.apache.org/lucene-java/LuceneFAQ?highlight=%282gb%29 then it's talking about an *operating system* limitation. So I wouldn't worry about this unless your op system is a problem. What are you running on? Erick On 8/13/07, rohit saini wrote: > > Hi all, > > I have bulk of data to be indexed and that may cross index file size of > 2GB. > As lucene faq tells that if index file size increses to 2GB there will be > problems. but faq tells to make index subdirectory in this case. I have > tried to do so made a index subdirectory in index main directory when > index > file size increses to 2GB but during search I don't get any result from > index subdirectory. do I need to search recursively but in that case there > will be more than "hits" object then how to combine them and return a > single > result to the user? Please tell me .... > > Thanks & Regards, > > Rohit > ------=_Part_26932_14752397.1187011474047--