Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: java-user@lucene.apache.org
Received-SPF: pass (athena.apache.org: domain of lists@nabble.com designates
 216.139.236.158 as permitted sender)
Message-ID: <16021739.post@talk.nabble.com>
Date: Wed, 12 Mar 2008 23:07:35 -0700 (PDT)
From: Sebastin <sebasmtech@gmail.com>
To: java-user@lucene.apache.org
Subject: Re: Good way of Indexing TextFiles
In-Reply-To: <15950791.post@talk.nabble.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Transfer-Encoding: 7bit
References: <15950791.post@talk.nabble.com>


Hi All,
        I tried one Indexing Stratergy:  
             1.I am having unique numbers as the search column for ex : my
search query should be

  9840836588 AND dateSc:[13/03/2008 TO 16/03/2008]

while Indexing the numbers i divide the number by 30000 

9840836588%30000 = 26588

creating a folder in the foloowing format 

"/200080301-200080316/26588"

I index and store the records in that folder.so while searching i get the
modulo and search the records only in that folder.

is it a good way of indexing?  
 
               
Sebastin wrote:
> 
> Hi All,
>        I am going to create a Lucene Index Store of Size 300 GB per
> month.I read Lucene Index Performance tips in wiki.can anyone suggest what
> are all the steps need to be followed while dealing with big Indexes.My
> Index Store gets updated every second.I used to search 15 days records
> approximately 150 GB records,in a time.Does anyone give me a clue,what
> have to set JVM for both Index and Search to avoid Out of memory error and
> how can i create Index store for large Indexes?    
> 

-- 
View this message in context: http://www.nabble.com/Good-way-of-Indexing-TextFiles-tp15950791p16021739.html
Sent from the Lucene - Java Users mailing list archive at Nabble.com.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org