ignite-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From vtieu <vt...@yahoo.com>
Subject Increase Java heap space for Ignite
Date Thu, 29 Oct 2015 17:18:10 GMT
Hi

In Ignite's default-config.xml file I have the following cache configuration
define:
    <bean class="org.apache.ignite.configuration.CacheConfiguration">
        
        <property name="memoryMode" value="ONHEAP_TIERED"/>

        
        <property name="offHeapMaxMemory" value="0"/>
        
        <property name="evictionPolicy">
            <bean
class="org.apache.ignite.cache.eviction.fifo.FifoEvictionPolicy">
                
                <property name="maxSize" value="10000000"/>
            </bean>
        </property>
    </bean>

I am storing one large chunk of data using Ignite Spark share RDD:


JavaIgniteRDD<String, MyData> myRdd =ic.fromCache("TestData");
:
myRdd.savePair(myPairRdd); // myPairRdd just have one pair with the large
data as value


When this is submitted to Spark execution, the Ignite server get the
following exception:
[12:21:06] Topology snapshot [ver=60, servers=1, clients=0, CPUs=8,
heap=1.0GB]
[12:21:34] Topology snapshot [ver=61, servers=1, clients=1, CPUs=8,
heap=16.0GB]
Exception in thread "ignite-#7%pub-null%" java.lang.OutOfMemoryError: Java
heap space
        at
org.apache.ignite.marshaller.optimized.OptimizedObjectInputStream$HandleTable.grow(OptimizedObjectInputStream.java:1074)
        at
org.apache.ignite.marshaller.optimized.OptimizedObjectInputStream$HandleTable.assign(OptimizedObjectInputStream.java:1032)
        at
org.apache.ignite.marshaller.optimized.OptimizedObjectInputStream.readString(OptimizedObjectInputStream.java:866)
        at
org.apache.ignite.marshaller.optimized.OptimizedObjectInputStream.readObjectOverride(OptimizedObjectInputStream.java:272)
        at java.io.ObjectInputStream.readObject(ObjectInputStream.java:365)
        at
org.apache.ignite.marshaller.optimized.OptimizedObjectInputStream.readArray(OptimizedObjectInputStream.java:361)
        at
org.apache.ignite.marshaller.optimized.OptimizedObjectInputStream.readObjectOverride(OptimizedObjectInputStream.java:269)
        at java.io.ObjectInputStream.readObject(ObjectInputStream.java:365)
        at
org.apache.ignite.marshaller.optimized.OptimizedObjectInputStream.readFields(OptimizedObjectInputStream.java:482)
        at
org.apache.ignite.marshaller.optimized.OptimizedObjectInputStream.readSerializable(OptimizedObjectInputStream.java:570)
        at
org.apache.ignite.marshaller.optimized.OptimizedClassDescriptor.read(OptimizedClassDescriptor.java:808)
        at
org.apache.ignite.marshaller.optimized.OptimizedObjectInputStream.readObjectOverride(OptimizedObjectInputStream.java:315)
        at java.io.ObjectInputStream.readObject(ObjectInputStream.java:365)
        at
org.apache.ignite.marshaller.optimized.OptimizedObjectInputStream.readFields(OptimizedObjectInputStream.java:482)
        at
org.apache.ignite.marshaller.optimized.OptimizedObjectInputStream.readSerializable(OptimizedObjectInputStream.java:570)
        at
org.apache.ignite.marshaller.optimized.OptimizedClassDescriptor.read(OptimizedClassDescriptor.java:808)
        at
org.apache.ignite.marshaller.optimized.OptimizedObjectInputStream.readObjectOverride(OptimizedObjectInputStream.java:315)
        at java.io.ObjectInputStream.readObject(ObjectInputStream.java:365)
        at
org.apache.ignite.marshaller.optimized.OptimizedMarshaller.unmarshal(OptimizedMarshaller.java:240)
        at
org.apache.ignite.internal.processors.cacheobject.IgniteCacheObjectProcessorImpl.unmarshal(IgniteCacheObjectProcessorImpl.java:101)
        at
org.apache.ignite.internal.processors.cache.portable.CacheObjectPortableProcessorImpl.unmarshal(CacheObjectPortableProcessorImpl.java:730)
        at
org.apache.ignite.internal.processors.cache.CacheObjectImpl.finishUnmarshal(CacheObjectImpl.java:104)
        at
org.apache.ignite.internal.processors.datastreamer.DataStreamerUpdateJob.call(DataStreamerUpdateJob.java:116)
        at
org.apache.ignite.internal.processors.datastreamer.DataStreamProcessor.processRequest(DataStreamProcessor.java:297)
        at
org.apache.ignite.internal.processors.datastreamer.DataStreamProcessor.access$000(DataStreamProcessor.java:49)
        at
org.apache.ignite.internal.processors.datastreamer.DataStreamProcessor$1.onMessage(DataStreamProcessor.java:76)
        at
org.apache.ignite.internal.managers.communication.GridIoManager.processRegularMessage0(GridIoManager.java:811)
        at
org.apache.ignite.internal.managers.communication.GridIoManager.access$1500(GridIoManager.java:106)
        at
org.apache.ignite.internal.managers.communication.GridIoManager$5.run(GridIoManager.java:774)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)

My question is how can I increase the Java heap memory when I run the
ignite.sh?  Thanks.





--
View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Increase-Java-heap-space-for-Ignite-tp1768.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Mime
View raw message