lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Simon Willnauer <simon.willna...@googlemail.com>
Subject Re: Read large size index
Date Mon, 29 Jun 2009 12:44:14 GMT
Well, with this information I can hardly tell what the cause of the
OOM is. It would be really really helpful if you could figure out
where it happens. Do you get the OOM on the first try? I guess you do
not do any indexing in the background?!
What is your index "layout" I mean what kind of fields do you use for
search and again do you do any sorting. Did you try to run you app
with a bit more memory? Are you able to run you app outside of a
servlet container if you can not find the stacktrace in the logs?! Did
you try a profiler or something similar to figure out where is
happens?

simon

On Mon, Jun 29, 2009 at 2:35 PM, m.harig<m.harig@gmail.com> wrote:
>
>
>
> Simon Willnauer wrote:
>>
>> On Mon, Jun 29, 2009 at 1:48 PM, m.harig<m.harig@gmail.com> wrote:
>>>
>>>
>>>
>>> Simon Willnauer wrote:
>>>>
>>>> Hey there,
>>>> before going out to use hadoop (hadoop mailing list would help you
>>>> better I guess) you could provide more information about you
>>>> situation. For instance:
>>>> - how big is you index
>>>> - version of lucene
>>>> - which java vm
>>>> - how much heap space
>>>> - where does the OOM occure
>>>>
>>>> or maybe there is already an issue that is related to you like this
>>>> one: https://issues.apache.org/jira/browse/LUCENE-1566
>>>>
>>>> simon
>>>>
>>>> On Mon, Jun 29, 2009 at 12:49 PM, m.harig<m.harig@gmail.com> wrote:
>>>>>
>>>>> hello all
>>>>>
>>>>>
>>>>>        Am doing a search application on lucene, its working fine
when
>>>>> my
>>>>> index size is small, am getting java heap space error when am using
>>>>> large
>>>>> size index, i came to know about hadoop with lucene to solve this
>>>>> problem
>>>>> ,
>>>>> but i don't have any idea about hadoop , i've searched thru the net ,
>>>>> but
>>>>> i
>>>>> can't find better solutions , am tired of searching , am very curios
if
>>>>> some1 tell me how to integrate lucene with hadoop , and i'll be very
>>>>> thankful to you , please any1 help me
>>>>> --
>>>>> View this message in context:
>>>>> http://www.nabble.com/Read-large-size-index-tp24251993p24251993.html
>>>>> Sent from the Lucene - Java Users mailing list archive at Nabble.com.
>>>>>
>>>>>
>>>>> ---------------------------------------------------------------------
>>>>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>>>>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>>>>
>>>>>
>>>>
>>>> ---------------------------------------------------------------------
>>>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>>>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>>>
>>>>
>>>>
>>>
>> Hey there,
>> 1GB is not a big index though. What happens when you search? Can you
>> post the stacktrace where the OOM occurs? Do you do any kind of
>> sorting in your application?
>>
>> simon
>>> i've posted a mail at hadoop lucene forum too , but i didn't get any
>>> response. my index size is 1GB , am using lucene 2.3.0 , java 1.6 , am
>>> setting 1024 as java max , when i tried to search a query it gives me
>>> java
>>> heap space . please any one help me .
>>>
>>> --
>>> View this message in context:
>>> http://www.nabble.com/Read-large-size-index-tp24251993p24252732.html
>>> Sent from the Lucene - Java Users mailing list archive at Nabble.com.
>>>
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>>
>>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>
>>
>>
>
>
> Thanks Simon,
>         Am running my application on tomcat 6.0 , i set java heap max as
> 256MB for tomcat , when i tried to search a query it just showing me heap
> space error.
>
>
> --
> View this message in context: http://www.nabble.com/Read-large-size-index-tp24251993p24253338.html
> Sent from the Lucene - Java Users mailing list archive at Nabble.com.
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
>

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


Mime
View raw message