lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "m.harig" <m.ha...@gmail.com>
Subject Re: Read large size index
Date Mon, 29 Jun 2009 12:35:14 GMT



Simon Willnauer wrote:
> 
> On Mon, Jun 29, 2009 at 1:48 PM, m.harig<m.harig@gmail.com> wrote:
>>
>>
>>
>> Simon Willnauer wrote:
>>>
>>> Hey there,
>>> before going out to use hadoop (hadoop mailing list would help you
>>> better I guess) you could provide more information about you
>>> situation. For instance:
>>> - how big is you index
>>> - version of lucene
>>> - which java vm
>>> - how much heap space
>>> - where does the OOM occure
>>>
>>> or maybe there is already an issue that is related to you like this
>>> one: https://issues.apache.org/jira/browse/LUCENE-1566
>>>
>>> simon
>>>
>>> On Mon, Jun 29, 2009 at 12:49 PM, m.harig<m.harig@gmail.com> wrote:
>>>>
>>>> hello all
>>>>
>>>>
>>>>        Am doing a search application on lucene, its working fine when
>>>> my
>>>> index size is small, am getting java heap space error when am using
>>>> large
>>>> size index, i came to know about hadoop with lucene to solve this
>>>> problem
>>>> ,
>>>> but i don't have any idea about hadoop , i've searched thru the net ,
>>>> but
>>>> i
>>>> can't find better solutions , am tired of searching , am very curios if
>>>> some1 tell me how to integrate lucene with hadoop , and i'll be very
>>>> thankful to you , please any1 help me
>>>> --
>>>> View this message in context:
>>>> http://www.nabble.com/Read-large-size-index-tp24251993p24251993.html
>>>> Sent from the Lucene - Java Users mailing list archive at Nabble.com.
>>>>
>>>>
>>>> ---------------------------------------------------------------------
>>>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>>>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>>>
>>>>
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>>
>>>
>>>
>>
> Hey there,
> 1GB is not a big index though. What happens when you search? Can you
> post the stacktrace where the OOM occurs? Do you do any kind of
> sorting in your application?
> 
> simon
>> i've posted a mail at hadoop lucene forum too , but i didn't get any
>> response. my index size is 1GB , am using lucene 2.3.0 , java 1.6 , am
>> setting 1024 as java max , when i tried to search a query it gives me
>> java
>> heap space . please any one help me .
>>
>> --
>> View this message in context:
>> http://www.nabble.com/Read-large-size-index-tp24251993p24252732.html
>> Sent from the Lucene - Java Users mailing list archive at Nabble.com.
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>
>>
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
> 
> 
> 


Thanks Simon,
         Am running my application on tomcat 6.0 , i set java heap max as
256MB for tomcat , when i tried to search a query it just showing me heap
space error.


-- 
View this message in context: http://www.nabble.com/Read-large-size-index-tp24251993p24253338.html
Sent from the Lucene - Java Users mailing list archive at Nabble.com.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


Mime
View raw message