ignite-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From rishi007bansod <rishi007ban...@gmail.com>
Subject Error while starting service grid with persistent store enabled
Date Thu, 03 Aug 2017 13:26:51 GMT
Hi,
    I am getting following error when I enable persistent store and using
service grid(when more than 1 node is connected in grid)


[18:47:55]    __________  ________________ 
[18:47:55]   /  _/ ___/ |/ /  _/_  __/ __/ 
[18:47:55]  _/ // (7 7    // /  / / / _/   
[18:47:55] /___/\___/_/|_/___/ /_/ /___/  
[18:47:55] 
[18:47:55] ver. 2.1.0#20170720-sha1:a6ca5c8a
[18:47:55] 2017 Copyright(C) Apache Software Foundation
[18:47:55] 
[18:47:55] Ignite documentation: http://ignite.apache.org
[18:47:55] 
[18:47:55] Quiet mode.
[18:47:55]   ^-- Logging to file
'/home/rishikesh/apache-ignite-fabric-2.1.0-bin/work/log/ignite-e36f2795.0.log'
[18:47:55]   ^-- To see **FULL** console log here add -DIGNITE_QUIET=false
or "-v" to ignite.{sh|bat}
[18:47:55] 
[18:47:55] OS: Linux 3.10.0-229.14.1.el7.x86_64 amd64
[18:47:55] VM information: Java(TM) SE Runtime Environment 1.8.0_71-b15
Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.71-b15
[18:47:55] Configured plugins:
[18:47:55]   ^-- None
[18:47:55] 
[18:47:56] Message queue limit is set to 0 which may lead to potential OOMEs
when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to
message queues growth on sender and receiver sides.
[18:47:56] Security status [authentication=off, tls/ssl=off]
[18:47:56] Performance suggestions for grid  (fix if possible)
[18:47:56] To disable, set -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true
[18:47:56]   ^-- Enable G1 Garbage Collector (add '-XX:+UseG1GC' to JVM
options)
[18:47:56]   ^-- Specify JVM heap max size (add '-Xmx<size>[g|G|m|M|k|K]' to
JVM options)
[18:47:56]   ^-- Set max direct memory size if getting 'OOME: Direct buffer
memory' (add '-XX:MaxDirectMemorySize=<size>[g|G|m|M|k|K]' to JVM options)
[18:47:56]   ^-- Disable processing of calls to System.gc() (add
'-XX:+DisableExplicitGC' to JVM options)
[18:47:56]   ^-- Speed up flushing of dirty pages by OS (alter
vm.dirty_expire_centisecs parameter by setting to 500)
[18:47:56] Refer to this page for more performance suggestions:
https://apacheignite.readme.io/docs/jvm-and-system-tuning
[18:47:56] 
[18:47:56] To start Console Management & Monitoring run
ignitevisorcmd.{sh|bat}
[18:47:56] 
[18:47:56] Ignite node started OK (id=e36f2795)
[18:47:56] Topology snapshot [ver=108, servers=9, clients=0, CPUs=56,
heap=59.0GB]
[18:47:57] Default checkpoint page buffer size is too small, setting to an
adjusted value: 2.0 GiB
[18:48:05] Cancelled rebalancing from all nodes [topology=null]
[18:48:07,122][SEVERE][exchange-worker-#106%null%][GridCachePartitionExchangeManager]
Failed to wait for completion of partition map exchange (preloading will not
start): GridDhtPartitionsExchangeFuture [dummy=false, forcePreload=false,
reassign=false, discoEvt=DiscoveryCustomEvent [customMsg=null,
affTopVer=AffinityTopologyVersion [topVer=108, minorTopVer=1],
super=DiscoveryEvent [evtNode=TcpDiscoveryNode
[id=e36f2795-f680-44fe-81bb-b7f10279a0ba, addrs=[0:0:0:0:0:0:0:1%lo,
127.0.0.1, 192.168.140.44],
sockAddrs=[pinta.testing.com/192.168.140.44:47508,
/0:0:0:0:0:0:0:1%lo:47508, /127.0.0.1:47508], discPort=47508, order=108,
intOrder=59, lastExchangeTime=1501766287107, loc=true,
ver=2.1.0#20170720-sha1:a6ca5c8a, isClient=false], topVer=108,
nodeId8=e36f2795, msg=null, type=DISCOVERY_CUSTOM_EVT,
tstamp=1501766277038]], crd=TcpDiscoveryNode
[id=1352d67c-64de-4979-aa00-8335edb20683, addrs=[0:0:0:0:0:0:0:1%lo,
127.0.0.1, 192.168.140.44],
sockAddrs=[pinta.testing.com/192.168.140.44:47500,
/0:0:0:0:0:0:0:1%lo:47500, /127.0.0.1:47500], discPort=47500, order=100,
intOrder=51, lastExchangeTime=1501766276774, loc=false,
ver=2.1.0#20170720-sha1:a6ca5c8a, isClient=false],
exchId=GridDhtPartitionExchangeId [topVer=AffinityTopologyVersion
[topVer=108, minorTopVer=1], nodeId=e36f2795, evt=DISCOVERY_CUSTOM_EVT],
added=true, initFut=GridFutureAdapter [ignoreInterrupts=false, state=DONE,
res=true, hash=1885469686], init=true, lastVer=null,
partReleaseFut=GridCompoundFuture [rdc=null, initFlag=1, lsnrCalls=4,
done=true, cancelled=false, err=null, futs=[true, true, true, true]],
exchActions=null, affChangeMsg=null, skipPreload=false,
clientOnlyExchange=false, initTs=1501766277058, centralizedAff=false,
changeGlobalStateE=null, forcedRebFut=null, done=true, evtLatch=0,
remaining=[f5f31d39-d8e6-4a7a-897f-9c693c689438,
e79ff60d-abd2-4929-b627-749040cbe1e7, 34ec752d-ac47-4105-8275-53199a03d5cf,
f81d1cdc-20e8-455c-ab80-e150b5283bb9, 83117cdd-808b-4136-a25d-e7f3500ae59d,
1352d67c-64de-4979-aa00-8335edb20683, f71f01b9-24a0-47d5-885d-61f542b406e2,
19ff8832-436e-4ef2-a710-197fc16c1a7d], super=GridFutureAdapter
[ignoreInterrupts=false, state=DONE, res=class o.a.i.IgniteCheckedException:
Cluster state change failed, hash=1200929855]]
class org.apache.ignite.IgniteCheckedException: Cluster state change failed
	at
org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture.processMessage(GridDhtPartitionsExchangeFuture.java:2045)
	at
org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture.access$700(GridDhtPartitionsExchangeFuture.java:109)
	at
org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture$4.apply(GridDhtPartitionsExchangeFuture.java:2011)
	at
org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture$4.apply(GridDhtPartitionsExchangeFuture.java:1999)
	at
org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:382)
	at
org.apache.ignite.internal.util.future.GridFutureAdapter.listen(GridFutureAdapter.java:352)
	at
org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture.onReceive(GridDhtPartitionsExchangeFuture.java:1999)
	at
org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager.processFullPartitionUpdate(GridCachePartitionExchangeManager.java:1354)
	at
org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager.access$1000(GridCachePartitionExchangeManager.java:125)
	at
org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager$3.onMessage(GridCachePartitionExchangeManager.java:297)
	at
org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager$3.onMessage(GridCachePartitionExchangeManager.java:295)
	at
org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager$MessageHandler.apply(GridCachePartitionExchangeManager.java:2243)
	at
org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager$MessageHandler.apply(GridCachePartitionExchangeManager.java:2225)
	at
org.apache.ignite.internal.processors.cache.GridCacheIoManager.processMessage(GridCacheIoManager.java:1042)
	at
org.apache.ignite.internal.processors.cache.GridCacheIoManager.onMessage0(GridCacheIoManager.java:561)
	at
org.apache.ignite.internal.processors.cache.GridCacheIoManager.handleMessage(GridCacheIoManager.java:378)
	at
org.apache.ignite.internal.processors.cache.GridCacheIoManager.handleMessage(GridCacheIoManager.java:304)
	at
org.apache.ignite.internal.processors.cache.GridCacheIoManager.access$100(GridCacheIoManager.java:99)
	at
org.apache.ignite.internal.processors.cache.GridCacheIoManager$1.onMessage(GridCacheIoManager.java:293)
	at
org.apache.ignite.internal.managers.communication.GridIoManager.invokeListener(GridIoManager.java:1556)
	at
org.apache.ignite.internal.managers.communication.GridIoManager.processRegularMessage0(GridIoManager.java:1184)
	at
org.apache.ignite.internal.managers.communication.GridIoManager.access$4200(GridIoManager.java:126)
	at
org.apache.ignite.internal.managers.communication.GridIoManager$9.run(GridIoManager.java:1097)
	at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)
[18:48:07] Ignite node stopped OK [uptime=00:00:10:272]
Exception in thread "main" class org.apache.ignite.IgniteException: Failed
to activate cluster
	at
org.apache.ignite.internal.util.IgniteUtils.convertException(IgniteUtils.java:957)
	at org.apache.ignite.internal.IgniteKernal.active(IgniteKernal.java:3427)
	at packagetest.MainServiceDeployment.main(MainServiceDeployment.java:120)
Caused by: class org.apache.ignite.IgniteCheckedException: Failed to
activate cluster
	Suppressed: java.lang.NullPointerException
		at
org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager.getPageMemoryForCacheGroup(GridCacheDatabaseSharedManager.java:1451)
		at
org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager.restoreMemory(GridCacheDatabaseSharedManager.java:1396)
		at
org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager.readCheckpointAndRestoreMemory(GridCacheDatabaseSharedManager.java:530)
		at
org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture.onClusterStateChangeRequest(GridDhtPartitionsExchangeFuture.java:770)
		at
org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture.init(GridDhtPartitionsExchangeFuture.java:574)
		at
org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager$ExchangeWorker.body(GridCachePartitionExchangeManager.java:1901)
		at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
		at java.lang.Thread.run(Thread.java:745)
	Suppressed: java.lang.NullPointerException
		at
org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager.getPageMemoryForCacheGroup(GridCacheDatabaseSharedManager.java:1451)
		at
org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager.restoreMemory(GridCacheDatabaseSharedManager.java:1396)
		at
org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager.readCheckpointAndRestoreMemory(GridCacheDatabaseSharedManager.java:530)
		at
org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture.onClusterStateChangeRequest(GridDhtPartitionsExchangeFuture.java:770)
		at
org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture.init(GridDhtPartitionsExchangeFuture.java:574)
		at
org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager$ExchangeWorker.body(GridCachePartitionExchangeManager.java:1901)
		at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
		at java.lang.Thread.run(Thread.java:745)
	Suppressed: java.lang.NullPointerException
		at
org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager.getPageMemoryForCacheGroup(GridCacheDatabaseSharedManager.java:1451)
		at
org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager.restoreMemory(GridCacheDatabaseSharedManager.java:1396)
		at
org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager.readCheckpointAndRestoreMemory(GridCacheDatabaseSharedManager.java:530)
		at
org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture.onClusterStateChangeRequest(GridDhtPartitionsExchangeFuture.java:770)
		at
org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture.init(GridDhtPartitionsExchangeFuture.java:574)
		at
org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager$ExchangeWorker.body(GridCachePartitionExchangeManager.java:1901)
		at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
		at java.lang.Thread.run(Thread.java:745)
	Suppressed: java.lang.NullPointerException
		at
org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager.getPageMemoryForCacheGroup(GridCacheDatabaseSharedManager.java:1451)
		at
org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager.restoreMemory(GridCacheDatabaseSharedManager.java:1396)
		at
org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager.readCheckpointAndRestoreMemory(GridCacheDatabaseSharedManager.java:530)
		at
org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture.onClusterStateChangeRequest(GridDhtPartitionsExchangeFuture.java:770)
		at
org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture.init(GridDhtPartitionsExchangeFuture.java:574)
		at
org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager$ExchangeWorker.body(GridCachePartitionExchangeManager.java:1901)
		at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
		at java.lang.Thread.run(Thread.java:745)
	Suppressed: java.lang.NullPointerException
		at
org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager.getPageMemoryForCacheGroup(GridCacheDatabaseSharedManager.java:1451)
		at
org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager.restoreMemory(GridCacheDatabaseSharedManager.java:1396)
		at
org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager.readCheckpointAndRestoreMemory(GridCacheDatabaseSharedManager.java:530)
		at
org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture.onClusterStateChangeRequest(GridDhtPartitionsExchangeFuture.java:770)
		at
org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture.init(GridDhtPartitionsExchangeFuture.java:574)
		at
org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager$ExchangeWorker.body(GridCachePartitionExchangeManager.java:1901)
		at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
		at java.lang.Thread.run(Thread.java:745)
	Suppressed: java.lang.NullPointerException
		at
org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager.getPageMemoryForCacheGroup(GridCacheDatabaseSharedManager.java:1451)
		at
org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager.restoreMemory(GridCacheDatabaseSharedManager.java:1396)
		at
org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager.readCheckpointAndRestoreMemory(GridCacheDatabaseSharedManager.java:530)
		at
org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture.onClusterStateChangeRequest(GridDhtPartitionsExchangeFuture.java:770)
		at
org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture.init(GridDhtPartitionsExchangeFuture.java:574)
		at
org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager$ExchangeWorker.body(GridCachePartitionExchangeManager.java:1901)
		at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
		at java.lang.Thread.run(Thread.java:745)
	Suppressed: java.lang.NullPointerException
		at
org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager.getPageMemoryForCacheGroup(GridCacheDatabaseSharedManager.java:1451)
		at
org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager.restoreMemory(GridCacheDatabaseSharedManager.java:1396)
		at
org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager.readCheckpointAndRestoreMemory(GridCacheDatabaseSharedManager.java:530)
		at
org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture.onClusterStateChangeRequest(GridDhtPartitionsExchangeFuture.java:770)
		at
org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture.init(GridDhtPartitionsExchangeFuture.java:574)
		at
org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager$ExchangeWorker.body(GridCachePartitionExchangeManager.java:1901)
		at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
		at java.lang.Thread.run(Thread.java:745)
	Suppressed: java.lang.NullPointerException
		at
org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager.getPageMemoryForCacheGroup(GridCacheDatabaseSharedManager.java:1451)
		at
org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager.restoreMemory(GridCacheDatabaseSharedManager.java:1396)
		at
org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager.readCheckpointAndRestoreMemory(GridCacheDatabaseSharedManager.java:530)
		at
org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture.onClusterStateChangeRequest(GridDhtPartitionsExchangeFuture.java:770)
		at
org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture.init(GridDhtPartitionsExchangeFuture.java:574)
		at
org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager$ExchangeWorker.body(GridCachePartitionExchangeManager.java:1901)
		at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
		at java.lang.Thread.run(Thread.java:745)



Following are the memory policy settings I have used,

                                // Persistent Store configuration.
				PersistentStoreConfiguration psCfg = new PersistentStoreConfiguration();
				
				
				// Durable Memory configuration.
				MemoryConfiguration memCfg = new MemoryConfiguration();

				// Creating a custom memory policy for a new memory region.
				MemoryPolicyConfiguration plCfg = new MemoryPolicyConfiguration();

				
				// Policy/region name.
				plCfg.setName("test");

				// Setting initial size.
				plCfg.setInitialSize(100L * 1024 * 1024);

				// Setting maximum size(want ro use 200GB out of 256GB RAM)
				plCfg.setMaxSize(200L * 1024 * 1024 * 1024);

				
				// Applying the memory policy.
				memCfg.setMemoryPolicies(plCfg);
				
				igniteConfiguration.setPersistentStoreConfiguration(psCfg);
				igniteConfiguration.setMemoryConfiguration(memCfg);



What might be the issue?

Thanks,
Rishikesh



--
View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Error-while-starting-service-grid-with-persistent-store-enabled-tp15946.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Mime
View raw message