lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Simon Willnauer <simon.willna...@googlemail.com>
Subject Re: Read large size index
Date Mon, 29 Jun 2009 12:15:51 GMT
On Mon, Jun 29, 2009 at 1:48 PM, m.harig<m.harig@gmail.com> wrote:
>
>
>
> Simon Willnauer wrote:
>>
>> Hey there,
>> before going out to use hadoop (hadoop mailing list would help you
>> better I guess) you could provide more information about you
>> situation. For instance:
>> - how big is you index
>> - version of lucene
>> - which java vm
>> - how much heap space
>> - where does the OOM occure
>>
>> or maybe there is already an issue that is related to you like this
>> one: https://issues.apache.org/jira/browse/LUCENE-1566
>>
>> simon
>>
>> On Mon, Jun 29, 2009 at 12:49 PM, m.harig<m.harig@gmail.com> wrote:
>>>
>>> hello all
>>>
>>>
>>>        Am doing a search application on lucene, its working fine when my
>>> index size is small, am getting java heap space error when am using large
>>> size index, i came to know about hadoop with lucene to solve this problem
>>> ,
>>> but i don't have any idea about hadoop , i've searched thru the net , but
>>> i
>>> can't find better solutions , am tired of searching , am very curios if
>>> some1 tell me how to integrate lucene with hadoop , and i'll be very
>>> thankful to you , please any1 help me
>>> --
>>> View this message in context:
>>> http://www.nabble.com/Read-large-size-index-tp24251993p24251993.html
>>> Sent from the Lucene - Java Users mailing list archive at Nabble.com.
>>>
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>>
>>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>
>>
>>
>
Hey there,
1GB is not a big index though. What happens when you search? Can you
post the stacktrace where the OOM occurs? Do you do any kind of
sorting in your application?

simon
> i've posted a mail at hadoop lucene forum too , but i didn't get any
> response. my index size is 1GB , am using lucene 2.3.0 , java 1.6 , am
> setting 1024 as java max , when i tried to search a query it gives me java
> heap space . please any one help me .
>
> --
> View this message in context: http://www.nabble.com/Read-large-size-index-tp24251993p24252732.html
> Sent from the Lucene - Java Users mailing list archive at Nabble.com.
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
>

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


Mime
View raw message