lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Boon Low <boon....@dctfh.com>
Subject Re: Java heap space error
Date Thu, 24 Jul 2014 14:43:51 GMT
How about simply increasing the heap size if RAM is available? You should also check the update
handler config, e.g. auto commit, if docs aren’t being written to disk, they would be hanging
around in memory. And “openSearcher” setting too as opening new searchers consumes memory,
especially if expensive warm-up requests are configured.

Setup some graphs, monitoring the JVM heap, indexing rate, pending docs etc etc.

Boon

---
Boon Low
Lead Big Data / Search Engineer
DCT Family History


On 24 Jul 2014, at 15:12, François Schiettecatte <fschiettecatte@gmail.com<mailto:fschiettecatte@gmail.com>>
wrote:

A default garbage collector will be chosen for you by the VM, might help to get the stack
trace to look at.

François

On Jul 24, 2014, at 10:06 AM, Ameya Aware <ameya.aware@gmail.com<mailto:ameya.aware@gmail.com>>
wrote:

ooh ok.

So you want to say that since i am using large heap but didnt set my
garbage collection, thats why i why getting java heap space error?





On Thu, Jul 24, 2014 at 9:58 AM, Marcello Lorenzi <mlorenzi@sorint.it<mailto:mlorenzi@sorint.it>>
wrote:

I think that on large heap is suggested to monitor the garbage collection
behavior and try to add a strategy adapted to your performance.  On my
production environment with a heap of 6 GB I set this parameter (server
with 8 cores):

-server -Xms6144m -Xmx6144m -XX:MaxPermSize=512m
-Dcom.sun.management.jmxremote -XX:+UseParNewGC -XX:+UseConcMarkSweepGC
-XX:+CMSIncrementalMode -XX:+CMSParallelRemarkEnabled
-XX:+UseCMSInitiatingOccupancyOnly -XX:CMSInitiatingOccupancyFraction=70
-XX:ConcGCThreads=6 -XX:ParallelGCThreads=6

Marcello


On 07/24/2014 03:53 PM, Ameya Aware wrote:

I did not make any other change than this.. rest of the settings are
default.

Do i need to set garbage collection strategy?


On Thu, Jul 24, 2014 at 9:49 AM, Marcello Lorenzi <mlorenzi@sorint.it<mailto:mlorenzi@sorint.it>>
wrote:

Hi,
Did you set a Garbage collection strategy on your JVM ?

Marcello


On 07/24/2014 03:32 PM, Ameya Aware wrote:

Hi

I am in process of indexing around 2,00,000 documents.

I have increase java jeap space to 4 GB using below command :

java -Xmx4096M -Xms4096M -jar start.jar

Still after indexing around 15000 documents it gives java heap space
error
again.


Any fix for this?

Thanks,
Ameya







________________________________
This message is confidential and may contain privileged information. You should not disclose
its contents to any other person. If you are not the intended recipient, please notify the
sender named above immediately. It is expressly declared that this e-mail does not constitute
nor form part of a contract or unilateral obligation. Opinions, conclusions and other information
in this message that do not relate to the official business of D.C. Thomson Family History
shall be understood as neither given nor endorsed by it.
________________________________



This email has been checked for virus and other malicious content prior to
leaving our network.
Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message