lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From ilkay polat <ilkay_po...@yahoo.com>
Subject RE: Out of memory problem in search
Date Wed, 14 Jul 2010 12:48:47 GMT
Indeed, this is  good solution to that kind of problems. But same problem can be  occured
in future when logs are added to index file. 
For example, here 200,000 records have problem(These logs are collected in 13 days). 
With that reverse way, there will be maximum search range is 100,000. 
But if there is 400,000 records same problem will be occured(Max search space is 200,000 again).

Is there another way which do not consume so much memory  or consume restrict memory and
consume time instead of memory. This restriction come from our project hardware restrictions(Hardware
memory is 8GB in maximum situation)?

--- On Wed, 7/14/10, Uwe Schindler <uwe@thetaphi.de> wrote:

From: Uwe Schindler <uwe@thetaphi.de>
Subject: RE: Out of memory problem in search
To: java-user@lucene.apache.org
Date: Wednesday, July 14, 2010, 3:25 PM

Reverse the query sorting to display the last page.

-----
Uwe Schindler
H.-H.-Meier-Allee 63, D-28213 Bremen
http://www.thetaphi.de
eMail: uwe@thetaphi.de


> -----Original Message-----
> From: ilkay polat [mailto:ilkay_polat@yahoo.com]
> Sent: Wednesday, July 14, 2010 12:44 PM
> To: java-user@lucene.apache.org
> Subject: Out of memory problem in search
> 
> Hello Friends;
> 
> Recently, I have problem with lucene search - memory problem on the basis
> that indexed file is so big. (I have indexed some kinds of information and
this
> indexed file's size is nearly more than 40 gigabyte. )
> 
> I search the lucene indexed file with
> org.apache.lucene.search.Searcher.search(query, null, offset + limit, new
> Sort(new SortField("time", SortField.LONG, true))); (This provides to find
> (offset + limit) records to back.)
> 
> I use searching by range. For example, in web page I firstly search
records
> which are in [0, 100] range then second page [100, 200] I have nearly
200,000
> records at all. When I go to last page which means records between 200,000
-
> 100, 200,0, there is a memory problem(I have 4gb ram on running machine)
in
> jvm( out of memory error).
> 
> Is there a way to overcome this memory problem?
> 
> Thanks
> 
> --
> ilkay POLAT   Software Engineer
> TURKEY
> 
>   Gsm : (+90) 532 542 36 71
>   E-mail : ilkay_polat@yahoo.com
> 
> 
> 


---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org




      
Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message