ignite-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Pavel Pereslegin (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (IGNITE-9225) Cache 7 (With Persistence) configuration halted by failure handler.
Date Wed, 08 Aug 2018 10:15:00 GMT

    [ https://issues.apache.org/jira/browse/IGNITE-9225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16572982#comment-16572982
] 

Pavel Pereslegin edited comment on IGNITE-9225 at 8/8/18 10:14 AM:
-------------------------------------------------------------------

Hello [~Jokser].
Take a look at these changes, please.


was (Author: xtern):
Hello [~Jokser].
Take a look at this changes, please.

> Cache 7 (With Persistence) configuration halted by failure handler.
> -------------------------------------------------------------------
>
>                 Key: IGNITE-9225
>                 URL: https://issues.apache.org/jira/browse/IGNITE-9225
>             Project: Ignite
>          Issue Type: Bug
>    Affects Versions: 2.6
>            Reporter: Pavel Pereslegin
>            Assignee: Pavel Pereslegin
>            Priority: Major
>             Fix For: 2.7
>
>
> WalModeChangeCommonAbstractSelfTest uses default failure handler and can halt JVM.
> Example of such failure on TC: https://ci.ignite.apache.org/viewLog.html?buildId=1589136&buildTypeId=IgniteTests24Java8_Cache7&tab=buildResultsDiv
> Log output:
> {noformat}
> [12:51:02]W:		 [org.apache.ignite:ignite-core] [2018-08-04 09:51:02,859][ERROR][main][root]
Test failed.
> [12:51:02]W:		 [org.apache.ignite:ignite-core] junit.framework.AssertionFailedError:
Failed to wait for disconnect/reconnect event.
> [12:51:02]W:		 [org.apache.ignite:ignite-core] 	at junit.framework.Assert.fail(Assert.java:57)
> [12:51:02]W:		 [org.apache.ignite:ignite-core] 	at junit.framework.TestCase.fail(TestCase.java:227)
> [12:51:02]W:		 [org.apache.ignite:ignite-core] 	at org.apache.ignite.internal.IgniteClientReconnectAbstractTest.waitReconnectEvent(IgniteClientReconnectAbstractTest.java:122)
> [12:51:02]W:		 [org.apache.ignite:ignite-core] 	at org.apache.ignite.internal.IgniteClientReconnectAbstractTest.reconnectClientNodes(IgniteClientReconnectAbstractTest.java:314)
> [12:51:02]W:		 [org.apache.ignite:ignite-core] 	at org.apache.ignite.internal.IgniteClientReconnectAbstractTest.reconnectClientNode(IgniteClientReconnectAbstractTest.java:256)
> [12:51:02]W:		 [org.apache.ignite:ignite-core] 	at org.apache.ignite.internal.processors.cache.WalModeChangeAdvancedSelfTest.testClientReconnect(WalModeChangeAdvancedSelfTest.java:350)
> [12:51:02] :	 [Step 3/4] [2018-08-04 09:51:02,861][INFO ][main][root] >>> Stopping
test: WalModeChangeAdvancedSelfTest#testClientReconnect in 33858 ms <<<
> [12:51:02]W:		 [org.apache.ignite:ignite-core] 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
Method)
> [12:51:02] :	 [Step 3/4] [2018-08-04 09:51:02,861][INFO ][main][root] >>> Stopping
test class: WalModeChangeAdvancedSelfTest <<<
> [12:51:02]W:		 [org.apache.ignite:ignite-core] 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> [12:51:02] :	 [Step 3/4] [2018-08-04 09:51:02,861][INFO ][main][root] >>> Stopping
grid [name=cli, id=6481a605-7bfb-486d-a796-2a4f1c8d0469]
> [12:51:02]W:		 [org.apache.ignite:ignite-core] 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> [12:51:02]W:		 [org.apache.ignite:ignite-core] 	at java.lang.reflect.Method.invoke(Method.java:498)
> [12:51:02]W:		 [org.apache.ignite:ignite-core] 	at junit.framework.TestCase.runTest(TestCase.java:176)
> [12:51:02]W:		 [org.apache.ignite:ignite-core] 	at org.apache.ignite.testframework.junits.GridAbstractTest.runTestInternal(GridAbstractTest.java:2156)
> [12:51:02]W:		 [org.apache.ignite:ignite-core] 	at org.apache.ignite.testframework.junits.GridAbstractTest.access$000(GridAbstractTest.java:143)
> [12:51:02]W:		 [org.apache.ignite:ignite-core] 	at org.apache.ignite.testframework.junits.GridAbstractTest$5.run(GridAbstractTest.java:2071)
> [12:51:02]W:		 [org.apache.ignite:ignite-core] 	at java.lang.Thread.run(Thread.java:748)
> [12:51:03]W:		 [org.apache.ignite:ignite-core] Aug 04, 2018 9:51:03 AM org.apache.ignite.logger.java.JavaLogger
warning
> [12:51:03]W:		 [org.apache.ignite:ignite-core] WARNING: Local node was dropped from cluster
due to network problems, will try to reconnect with new id after 1ms (reconnect delay can
be changed using IGNITE_DISCO_FAILED_CLIENT_RECONNECT_DELAY system property) [newId=788c53f8-f985-449a-853e-bf47ed90e388,
prevId=6481a605-7bfb-486d-a796-2a4f1c8d0469, locNode=TcpDiscoveryNode [id=6481a605-7bfb-486d-a796-2a4f1c8d0469,
addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=18, intOrder=0,
lastExchangeTime=1533376229447, loc=true, ver=2.7.0#20180803-sha1:3ab8bbad, isClient=true],
nodeInitiatedFail=53d116c7-bb4f-43e9-b97c-6d3ce404cd51, msg=null]
> [12:51:03]W:		 [org.apache.ignite:ignite-core] Aug 04, 2018 9:51:03 AM org.apache.ignite.logger.java.JavaLogger
info
> [12:51:03]W:		 [org.apache.ignite:ignite-core] INFO: TCP discovery accepted incoming
connection [rmtAddr=/127.0.0.1, rmtPort=53351]
> [12:51:03]W:		 [org.apache.ignite:ignite-core] Aug 04, 2018 9:51:03 AM org.apache.ignite.logger.java.JavaLogger
info
> [12:51:03]W:		 [org.apache.ignite:ignite-core] INFO: TCP discovery spawning a new thread
for connection [rmtAddr=/127.0.0.1, rmtPort=53351]
> [12:51:03]W:		 [org.apache.ignite:ignite-core] Aug 04, 2018 9:51:03 AM org.apache.ignite.logger.java.JavaLogger
info
> [12:51:03]W:		 [org.apache.ignite:ignite-core] INFO: Started serving remote node connection
[rmtAddr=/127.0.0.1:53351, rmtPort=53351]
> [12:51:03]W:		 [org.apache.ignite:ignite-core] Aug 04, 2018 9:51:03 AM org.apache.ignite.logger.java.JavaLogger
info
> [12:51:03]W:		 [org.apache.ignite:ignite-core] INFO: Block join
> [12:51:03]W:		 [org.apache.ignite:ignite-core] Exception in thread "wal-load-cli" java.lang.IllegalStateException:
Grid is in invalid state to perform this operation. It either not started yet or has already
being or have stopped [igniteInstanceName=cli, state=STOPPING]
> [12:51:03]W:		 [org.apache.ignite:ignite-core] 	at org.apache.ignite.internal.GridKernalGatewayImpl.illegalState(GridKernalGatewayImpl.java:201)
> [12:51:03]W:		 [org.apache.ignite:ignite-core] 	at org.apache.ignite.internal.GridKernalGatewayImpl.readLock(GridKernalGatewayImpl.java:95)
> [12:51:03]W:		 [org.apache.ignite:ignite-core] 	at org.apache.ignite.internal.cluster.ClusterGroupAdapter.guard(ClusterGroupAdapter.java:169)
> [12:51:03]W:		 [org.apache.ignite:ignite-core] 	at org.apache.ignite.internal.cluster.IgniteClusterImpl.changeWalMode(IgniteClusterImpl.java:559)
> [12:51:03]W:		 [org.apache.ignite:ignite-core] 	at org.apache.ignite.internal.cluster.IgniteClusterImpl.disableWal(IgniteClusterImpl.java:546)
> [12:51:03]W:		 [org.apache.ignite:ignite-core] 	at org.apache.ignite.internal.processors.cache.WalModeChangeAdvancedSelfTest$2.run(WalModeChangeAdvancedSelfTest.java:325)
> [12:51:03]W:		 [org.apache.ignite:ignite-core] 	at java.lang.Thread.run(Thread.java:748)
> [12:51:08]W:		 [org.apache.ignite:ignite-core] Aug 04, 2018 9:51:08 AM org.apache.ignite.logger.java.JavaLogger
warning
> [12:51:08]W:		 [org.apache.ignite:ignite-core] WARNING: Failed to left node: timeout
[nodeId=TcpDiscoveryNode [id=788c53f8-f985-449a-853e-bf47ed90e388, addrs=ArrayList [127.0.0.1],
sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=18, intOrder=0, lastExchangeTime=1533376229447,
loc=true, ver=2.7.0#20180803-sha1:3ab8bbad, isClient=true]]
> [12:51:08]W:		 [org.apache.ignite:ignite-core] Aug 04, 2018 9:51:08 AM java.util.logging.LogManager$RootLogger
log
> [12:51:08]W:		 [org.apache.ignite:ignite-core] SEVERE: Critical system error detected.
Will be handled accordingly to configured handler [hnd=class o.a.i.failure.StopNodeOrHaltFailureHandler,
failureCtx=FailureContext [type=CRITICAL_ERROR, err=class o.a.i.IgniteException: null]]
> [12:51:08]W:		 [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteException:
null
> [12:51:08]W:		 [org.apache.ignite:ignite-core] 	at org.apache.ignite.internal.DiscoverySpiTestListener.beforeJoin(DiscoverySpiTestListener.java:86)
> [12:51:08]W:		 [org.apache.ignite:ignite-core] 	at org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi.writeToSocket(TcpDiscoverySpi.java:1632)
> [12:51:08]W:		 [org.apache.ignite:ignite-core] 	at org.apache.ignite.internal.IgniteClientReconnectAbstractTest$TestTcpDiscoverySpi.writeToSocket(IgniteClientReconnectAbstractTest.java:432)
> [12:51:08]W:		 [org.apache.ignite:ignite-core] 	at org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi.writeToSocket(TcpDiscoverySpi.java:1588)
> [12:51:08]W:		 [org.apache.ignite:ignite-core] 	at org.apache.ignite.spi.discovery.tcp.ClientImpl.sendJoinRequest(ClientImpl.java:721)
> [12:51:08]W:		 [org.apache.ignite:ignite-core] 	at org.apache.ignite.spi.discovery.tcp.ClientImpl.joinTopology(ClientImpl.java:586)
> [12:51:08]W:		 [org.apache.ignite:ignite-core] 	at org.apache.ignite.spi.discovery.tcp.ClientImpl.access$900(ClientImpl.java:137)
> [12:51:08]W:		 [org.apache.ignite:ignite-core] 	at org.apache.ignite.spi.discovery.tcp.ClientImpl$MessageWorker.tryJoin(ClientImpl.java:1920)
> [12:51:08]W:		 [org.apache.ignite:ignite-core] 	at org.apache.ignite.spi.discovery.tcp.ClientImpl$MessageWorker.body(ClientImpl.java:1824)
> [12:51:08]W:		 [org.apache.ignite:ignite-core] 	at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
> [12:51:08]W:		 [org.apache.ignite:ignite-core] 	at org.apache.ignite.spi.discovery.tcp.ClientImpl$1.body(ClientImpl.java:295)
> [12:51:08]W:		 [org.apache.ignite:ignite-core] 	at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:62)
> [12:51:08]W:		 [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.IgniteInterruptedCheckedException:
null
> [12:51:08]W:		 [org.apache.ignite:ignite-core] 	at org.apache.ignite.internal.util.IgniteUtils.await(IgniteUtils.java:7544)
> [12:51:08]W:		 [org.apache.ignite:ignite-core] 	at org.apache.ignite.internal.DiscoverySpiTestListener.beforeJoin(DiscoverySpiTestListener.java:82)
> [12:51:08]W:		 [org.apache.ignite:ignite-core] 	... 11 more
> [12:51:08]W:		 [org.apache.ignite:ignite-core] Caused by: java.lang.InterruptedException
> [12:51:08]W:		 [org.apache.ignite:ignite-core] 	at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:998)
> [12:51:08]W:		 [org.apache.ignite:ignite-core] 	at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304)
> [12:51:08]W:		 [org.apache.ignite:ignite-core] 	at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:231)
> [12:51:08]W:		 [org.apache.ignite:ignite-core] 	at org.apache.ignite.internal.util.IgniteUtils.await(IgniteUtils.java:7539)
> [12:51:08]W:		 [org.apache.ignite:ignite-core] 	... 12 more
> [12:51:08]W:		 [org.apache.ignite:ignite-core] 
> [12:51:08]W:		 [org.apache.ignite:ignite-core] Aug 04, 2018 9:51:08 AM java.util.logging.LogManager$RootLogger
log
> [12:51:08]W:		 [org.apache.ignite:ignite-core] SEVERE: JVM will be halted immediately
due to the failure: [failureCtx=FailureContext [type=CRITICAL_ERROR, err=class o.a.i.IgniteException:
null]]
> [12:51:08]W:		 [org.apache.ignite:ignite-core] Process exited with code 130
> [12:51:08]E:	 [Step 3/4] Process exited with code 130
> {noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message