From user-return-24085-archive-asf-public=cust-asf.ponee.io@ignite.apache.org Wed Jan 9 18:43:44 2019 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id E6210180669 for ; Wed, 9 Jan 2019 18:43:42 +0100 (CET) Received: (qmail 64253 invoked by uid 500); 9 Jan 2019 17:43:41 -0000 Mailing-List: contact user-help@ignite.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@ignite.apache.org Delivered-To: mailing list user@ignite.apache.org Received: (qmail 64240 invoked by uid 99); 9 Jan 2019 17:43:41 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 09 Jan 2019 17:43:41 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 4B63DC0189 for ; Wed, 9 Jan 2019 17:43:41 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.657 X-Spam-Level: * X-Spam-Status: No, score=1.657 tagged_above=-999 required=6.31 tests=[DKIMWL_WL_MED=-0.142, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id a7TAg6rd9aW6 for ; Wed, 9 Jan 2019 17:43:39 +0000 (UTC) Received: from mail-lf1-f45.google.com (mail-lf1-f45.google.com [209.85.167.45]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 09F546110C for ; Wed, 9 Jan 2019 17:43:39 +0000 (UTC) Received: by mail-lf1-f45.google.com with SMTP id l10so6261816lfh.9 for ; Wed, 09 Jan 2019 09:43:39 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=message-id:mime-version:to:from:subject:date:importance; bh=FxNIG5NPRVYlELdKL8HvWlx4ORoqmywczN8d/d2REPg=; b=dvV1SIM2k68tGsofZau9aDrFqmOzoJdFVUTtDd3w5z8zpa6sh8/NFwbv8KE/iTEf+m AIpPEke5jm7T/e6hxm/4HZACv//uwF7hBfVwdZ9+3BHHcCWcx9M/itEMU9nUjtUcxpwk QtRtnISiNP1XTk/P8jjRXYgB0pizXB8PiC6xEA/BoGTTA7qTyr9UymIk1QQfNK+4h9MM Tvy+1RSABuv0o3VQVkC7MuhmXGv0x9kyX8UBxOvS/GH4zudjymajo/d7MqfrMTYYkeyS vRnQJPxt4kHf2zOlY2lW82UjXO8wEBZ0f6bHVhn2AmPMgGAefuhlgxurh0qn+lsLA27k iEKg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:message-id:mime-version:to:from:subject:date :importance; bh=FxNIG5NPRVYlELdKL8HvWlx4ORoqmywczN8d/d2REPg=; b=NcxQ02IOAj/AyYoOkD2p6VOiDzz7V1GY8VJdROJBmDOHIqDy2SaIeT/rsPFDMtooW0 ZSKTcbrIjCC9O+/ovAqm5UmY1psaPTEIxad3Jv2lgNNNasnjVFXL1a6VajwTD8yDwjJn GVMdAxyvJfaIgnQ/EScYrwcMsM7juS6bzFDHkA6cCcYHT/G4Z333UNmeaYZvngD4cy28 UVUyWRZNZQ0Zht/6ZhZbPvdbZ+1/1BFxiAUUynG16FvCoQ7sQoTVkB/+qyNJQp4yqSDG eSBOuqEX7ngdZIG1iKIWteA07dh2v7J2TZMjmzYeOMK50eFPDYLAHgLq7ZsI8J44WbcN NJTA== X-Gm-Message-State: AJcUukdqUdkegaD40G4URkOJ32riYxUxWVFo7AEQRGy91sAbtqKlr+nk JBGsPT/DoILr8R3wH46RBQ95gwEo X-Google-Smtp-Source: ALg8bN4wsleYKAFl5s6Uk8BN+TwCZIKc2yvy+Cw5asthRRFDidsET9b4zzZX3y87RJjlIQvqNRVRmA== X-Received: by 2002:a19:910d:: with SMTP id t13mr3838938lfd.98.1547055817789; Wed, 09 Jan 2019 09:43:37 -0800 (PST) Received: from ?IPv6:::ffff:192.168.8.100? ([31.173.86.8]) by smtp.gmail.com with ESMTPSA id 11sm13951397lfq.89.2019.01.09.09.43.36 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Wed, 09 Jan 2019 09:43:37 -0800 (PST) Message-ID: <5c3632c9.1c69fb81.f7d77.14cb@mx.google.com> MIME-Version: 1.0 To: "user@ignite.apache.org" From: Andrey Davydov Subject: Failed to wait for partition map exchange on cluster activation Date: Wed, 9 Jan 2019 20:43:37 +0300 Importance: normal X-Priority: 3 Content-Type: multipart/alternative; boundary="_9B623BCE-B614-44BC-8B32-5F8B4488D171_" --_9B623BCE-B614-44BC-8B32-5F8B4488D171_ Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset="utf-8" Hello,=20 I found in test logs of my project that Ignite warns about failed partition= maps exchange. In test environment 3 Ignite 2.7 server nodes run in the sa= me JVM8 on Win10, using localhost networking. 2019-01-09 20:15:27,719 [sys-#164%TestNode-2%] INFO org.apache.ignite.inte= rnal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFu= ture:102 - Affinity changes applied in 10 ms. 2019-01-09 20:15:27,719 [sys-#163%TestNode-1%] INFO org.apache.ignite.inte= rnal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFu= ture:102 - Affinity changes applied in 10 ms. 2019-01-09 20:15:27,724 [sys-#164%TestNode-2%] INFO org.apache.ignite.inte= rnal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFu= ture:102 - Full map updating for 5 groups performed in 4 ms. 2019-01-09 20:15:27,724 [sys-#163%TestNode-1%] INFO org.apache.ignite.inte= rnal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFu= ture:102 - Full map updating for 5 groups performed in 5 ms. 2019-01-09 20:15:27,725 [sys-#163%TestNode-1%] INFO org.apache.ignite.inte= rnal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFu= ture:102 - Finish exchange future [startVer=3DAffinityTopologyVersion [topV= er=3D3, minorTopVer=3D1], resVer=3DAffinityTopologyVersion [topVer=3D3, min= orTopVer=3D1], err=3Dnull] 2019-01-09 20:15:27,725 [sys-#164%TestNode-2%] INFO org.apache.ignite.inte= rnal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFu= ture:102 - Finish exchange future [startVer=3DAffinityTopologyVersion [topV= er=3D3, minorTopVer=3D1], resVer=3DAffinityTopologyVersion [topVer=3D3, min= orTopVer=3D1], err=3Dnull] 2019-01-09 20:15:28,710 [db-checkpoint-thread-#157%TestNode-1%] INFO org.a= pache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedM= anager:102 - Checkpoint started [checkpointId=3D443748a9-c1a5-4b3b-96e4-04a= 0862829ec, startPtr=3DFileWALPointer [idx=3D0, fileOff=3D929726, len=3D3114= 3], checkpointLockWait=3D0ms, checkpointLockHoldTime=3D6ms, walCpRecordFsyn= cDuration=3D248ms, pages=3D204, reason=3D'node started'] 2019-01-09 20:15:28,713 [db-checkpoint-thread-#151%TestNode-0%] INFO org.a= pache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedM= anager:102 - Checkpoint started [checkpointId=3Dcbc928e1-4ecd-40ae-9791-c6b= a20c3669b, startPtr=3DFileWALPointer [idx=3D0, fileOff=3D929726, len=3D3114= 3], checkpointLockWait=3D0ms, checkpointLockHoldTime=3D8ms, walCpRecordFsyn= cDuration=3D257ms, pages=3D204, reason=3D'node started'] 2019-01-09 20:15:28,715 [db-checkpoint-thread-#146%TestNode-2%] INFO org.a= pache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedM= anager:102 - Checkpoint started [checkpointId=3Def4c3d02-ca01-4d67-8128-48d= 4dc99aabc, startPtr=3DFileWALPointer [idx=3D0, fileOff=3D929726, len=3D3114= 3], checkpointLockWait=3D0ms, checkpointLockHoldTime=3D22ms, walCpRecordFsy= ncDuration=3D289ms, pages=3D204, reason=3D'node started'] 2019-01-09 20:15:30,788 [db-checkpoint-thread-#157%TestNode-1%] INFO org.a= pache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedM= anager:102 - Checkpoint finished [cpId=3D443748a9-c1a5-4b3b-96e4-04a0862829= ec, pages=3D204, markPos=3DFileWALPointer [idx=3D0, fileOff=3D929726, len= =3D31143], walSegmentsCleared=3D0, walSegmentsCovered=3D[], markDuration=3D= 1103ms, pagesWrite=3D84ms, fsync=3D1992ms, total=3D3179ms] 2019-01-09 20:15:30,858 [db-checkpoint-thread-#151%TestNode-0%] INFO org.a= pache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedM= anager:102 - Checkpoint finished [cpId=3Dcbc928e1-4ecd-40ae-9791-c6ba20c366= 9b, pages=3D204, markPos=3DFileWALPointer [idx=3D0, fileOff=3D929726, len= =3D31143], walSegmentsCleared=3D0, walSegmentsCovered=3D[], markDuration=3D= 1213ms, pagesWrite=3D79ms, fsync=3D2066ms, total=3D3358ms] 2019-01-09 20:15:30,998 [db-checkpoint-thread-#146%TestNode-2%] INFO org.a= pache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedM= anager:102 - Checkpoint finished [cpId=3Def4c3d02-ca01-4d67-8128-48d4dc99aa= bc, pages=3D204, markPos=3DFileWALPointer [idx=3D0, fileOff=3D929726, len= =3D31143], walSegmentsCleared=3D0, walSegmentsCovered=3D[], markDuration=3D= 1262ms, pagesWrite=3D79ms, fsync=3D2203ms, total=3D3544ms] 2019-01-09 20:15:37,510 [exchange-worker-#44%TestNode-0%] WARN org.apache.= ignite.internal.diagnostic:118 - Failed to wait for partition map exchange = [topVer=3DAffinityTopologyVersion [topVer=3D3, minorTopVer=3D1], node=3D454= d2051-cea6-4f2c-99a7-7c5698494175]. Dumping pending objects that might be t= he cause:=20 2019-01-09 20:15:37,510 [exchange-worker-#44%TestNode-0%] WARN org.apache.= ignite.internal.diagnostic:118 - Ready affinity version: AffinityTopologyVe= rsion [topVer=3D-1, minorTopVer=3D0] 2019-01-09 20:15:37,515 [exchange-worker-#44%TestNode-0%] WARN org.apache.= ignite.internal.diagnostic:118 - Last exchange future: =E2=80=A6 2019-01-09 20:15:37,515 [exchange-worker-#44%TestNode-0%] WARN org.apache.= ignite.internal.processors.cache.GridCachePartitionExchangeManager:118 - Fi= rst 10 pending exchange futures [total=3D0] 2019-01-09 20:15:37,518 [exchange-worker-#44%TestNode-0%] WARN org.apache.= ignite.internal.diagnostic:118 - Last 10 exchange futures (total: 1): 2019-01-09 20:15:37,519 [exchange-worker-#44%TestNode-0%] WARN org.apache.= ignite.internal.diagnostic:118 - >>> GridDhtPartitionsExchangeFuture [topVe= r=3DAffinityTopologyVersion [topVer=3D3, minorTopVer=3D1], evt=3DDISCOVERY_= CUSTOM_EVT, evtNode=3DTcpDiscoveryNode [id=3D454d2051-cea6-4f2c-99a7-7c5698= 494175, addrs=3D[127.0.0.1], sockAddrs=3D[/127.0.0.1:47500], discPort=3D475= 00, order=3D1, intOrder=3D1, lastExchangeTime=3D1547054137330, loc=3Dtrue, = ver=3D2.7.0#20181130-sha1:256ae401, isClient=3Dfalse], done=3Dfalse] 2019-01-09 20:15:37,520 [exchange-worker-#44%TestNode-0%] WARN org.apache.= ignite.internal.diagnostic:118 - Latch manager state: ExchangeLatchManager = [serverLatches=3D{}, clientLatches=3D{}] 2019-01-09 20:15:37,535 [exchange-worker-#132%TestNode-2%] WARN org.apache= .ignite.internal.diagnostic:118 - Failed to wait for partition map exchange= [topVer=3DAffinityTopologyVersion [topVer=3D3, minorTopVer=3D1], node=3Da8= e212dc-303e-4bc6-8bb6-fa2bc4c0478d]. Dumping pending objects that might be = the cause:=20 2019-01-09 20:15:37,535 [exchange-worker-#132%TestNode-2%] WARN org.apache= .ignite.internal.diagnostic:118 - Ready affinity version: AffinityTopologyV= ersion [topVer=3D-1, minorTopVer=3D0] 2019-01-09 20:15:37,536 [exchange-worker-#132%TestNode-2%] WARN org.apache= .ignite.internal.diagnostic:118 - Last exchange future:=20 2019-01-09 20:15:37,537 [exchange-worker-#132%TestNode-2%] WARN org.apache= .ignite.internal.processors.cache.GridCachePartitionExchangeManager:118 - F= irst 10 pending exchange futures [total=3D0] 2019-01-09 20:15:37,538 [exchange-worker-#132%TestNode-2%] WARN org.apache= .ignite.internal.diagnostic:118 - Last 10 exchange futures (total: 1): 2019-01-09 20:15:37,539 [exchange-worker-#132%TestNode-2%] WARN org.apache= .ignite.internal.diagnostic:118 - >>> GridDhtPartitionsExchangeFuture [topV= er=3DAffinityTopologyVersion [topVer=3D3, minorTopVer=3D1], evt=3DDISCOVERY= _CUSTOM_EVT, evtNode=3DTcpDiscoveryNode [id=3D454d2051-cea6-4f2c-99a7-7c569= 8494175, addrs=3D[127.0.0.1], sockAddrs=3D[/127.0.0.1:47500], discPort=3D47= 500, order=3D1, intOrder=3D1, lastExchangeTime=3D1547054124462, loc=3Dfalse= , ver=3D2.7.0#20181130-sha1:256ae401, isClient=3Dfalse], done=3Dfalse] 2019-01-09 20:15:37,540 [exchange-worker-#132%TestNode-2%] WARN org.apache= .ignite.internal.diagnostic:118 - Latch manager state: ExchangeLatchManager= [serverLatches=3D{}, clientLatches=3D{}] After that, everything works fine, but it cause every test to take more 10 = seconds to run. And I am afraid to use it in prod before I understand probl= em. Andrey. --_9B623BCE-B614-44BC-8B32-5F8B4488D171_ Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset="utf-8"

 

<= span lang=3DEN-US>Hello,

I found in test logs of my project that Ignite warns about failed partitio= n maps exchange. In test environment 3 Ignite 2.7 server nodes run in the s= ame JVM8 on Win10, using localhost networking.

 

= 2019-01-09 20:15:27,719 [sys-#164%TestNode-2%] INFO=C2=A0 org.apache.ignite= .internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExcha= ngeFuture:102 - Affinity changes applied in 10 ms.

2019-01-09 20:15:27,719 [sys-#163%TestNode-1%] INFO=C2=A0 org.ap= ache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPart= itionsExchangeFuture:102 - Affinity changes applied in 10 ms.

2019-01-09 20:15:27,724 [sys-#164%TestNode-2%] INFO= =C2=A0 org.apache.ignite.internal.processors.cache.distributed.dht.preloade= r.GridDhtPartitionsExchangeFuture:102 - Full map updating for 5 groups perf= ormed in 4 ms.

2019-01-09 20:15:27,724 [= sys-#163%TestNode-1%] INFO=C2=A0 org.apache.ignite.internal.processors.cach= e.distributed.dht.preloader.GridDhtPartitionsExchangeFuture:102 - Full map = updating for 5 groups performed in 5 ms.

2019-01-09 20:15:27,725 [sys-#163%TestNode-1%] INFO=C2=A0 org.apache.ignit= e.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExch= angeFuture:102 - Finish exchange future [startVer=3DAffinityTopologyVersion [topVer= =3D3, minorTopVer=3D1], resVer=3DAffinityTopologyVersion [topVer=3D3, minor= TopVer=3D1], err=3Dnull]

2019-01-09 20:15:27,725 [= sys-#164%TestNode-2%] INFO=C2=A0 org.apache.ignite.internal.processors.cach= e.distributed.dht.preloader.GridDhtPartitionsExchangeFuture:102 - Finish ex= change future [startVer=3DAffinityTopologyVersion [topVer=3D3, minorTopVer= =3D1], resVer=3DAffinityTopologyVersion [topVer=3D3, minorTopVer=3D1], err= =3Dnull]

2019-01-09 20:15:28,710 [db-checkpoint-th= read-#157%TestNode-1%] INFO=C2=A0 org.apache.ignite.internal.processors.cac= he.persistence.GridCacheDatabaseSharedManager:102 - Checkpoint started [che= ckpointId=3D443748a9-c1a5-4b3b-96e4-04a0862829ec, startPtr=3DFileWALPointer= [idx=3D0, fileOff=3D929726, len=3D31143], checkpointLockWait=3D0ms, checkp= ointLockHoldTime=3D6ms, walCpRecordFsyncDuration=3D248ms, pages=3D204, reas= on=3D'node started']

2019-01-09 20:15:28,713 [db-= checkpoint-thread-#151%TestNode-0%] INFO=C2=A0 org.apache.ignite.internal.p= rocessors.cache.persistence.GridCacheDatabaseSharedManager:102 - Checkpoint= started [checkpointId=3Dcbc928e1-4ecd-40ae-9791-c6ba20c3669b, startPtr=3DF= ileWALPointer [idx=3D0, fileOff=3D929726, len=3D31143], checkpointLockWait= =3D0ms, checkpointLockHoldTime=3D8ms, walCpRecordFsyncDuration=3D257ms, pag= es=3D204, reason=3D'node started']

2019-01-09 20:1= 5:28,715 [db-checkpoint-thread-#146%TestNode-2%] INFO=C2=A0 org.apache.igni= te.internal.processors.cache.persistence.GridCacheDatabaseSharedManager:102= - Checkpoint started [checkpointId=3Def4c3d02-ca01-4d67-8128-48d4dc99aabc,= startPtr=3DFileWALPointer [idx=3D0, fileOff=3D929726, len=3D31143], checkp= ointLockWait=3D0ms, checkpointLockHoldTime=3D22ms, walCpRecordFsyncDuration= =3D289ms, pages=3D204, reason=3D'node started']

20= 19-01-09 20:15:30,788 [db-checkpoint-thread-#157%TestNode-1%] INFO=C2=A0 or= g.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseShar= edManager:102 - Checkpoint finished [cpId=3D443748a9-c1a5-4b3b-96e4-04a0862= 829ec, pages=3D204, markPos=3DFileWALPointer [idx=3D0, fileOff=3D929726, le= n=3D31143], walSegmentsCleared=3D0, walSegmentsCovered=3D[], markDuration= =3D1103ms, pagesWrite=3D84ms, fsync=3D1992ms, total=3D3179ms]

2019-01-09 20:15:30,858 [db-checkpoint-thread-#151%TestNode-0%]= INFO=C2=A0 org.apache.ignite.internal.processors.cache.persistence.GridCac= heDatabaseSharedManager:102 - Checkpoint finished [cpId=3Dcbc928e1-4ecd-40a= e-9791-c6ba20c3669b, pages=3D204, markPos=3DFileWALPointer [idx=3D0, fileOf= f=3D929726, len=3D31143], walSegmentsCleared=3D0, walSegmentsCovered=3D[], = markDuration=3D1213ms, pagesWrite=3D79ms, fsync=3D2066ms, total=3D3358ms]

2019-01-09 20:15:30,998 [db-checkpoint-thread-#146%= TestNode-2%] INFO=C2=A0 org.apache.ignite.internal.processors.cache.persist= ence.GridCacheDatabaseSharedManager:102 - Checkpoint finished [cpId=3Def4c3= d02-ca01-4d67-8128-48d4dc99aabc, pages=3D204, markPos=3DFileWALPointer [idx= =3D0, fileOff=3D929726, len=3D31143], walSegmentsCleared=3D0, walSegmentsCo= vered=3D[], markDuration=3D1262ms, pagesWrite=3D79ms, fsync=3D2203ms, total= =3D3544ms]

2019-01-09 20:15:37,510 [exch= ange-worker-#44%TestNode-0%] WARN=C2=A0 org.apache.ignite.internal.diagnost= ic:118 - Failed to wait for partition map exchange [topVer=3DAffinityTopolo= gyVersion [topVer=3D3, minorTopVer=3D1], node=3D454d2051-cea6-4f2c-99a7-7c5= 698494175]. Dumping pending objects that might be the cause:

2019-01-09 20:15:37,510 [exchange-worker-#44%TestNode= -0%] WARN=C2=A0 org.apache.ignite.internal.diagnostic:118 - Ready affinity = version: AffinityTopologyVersion [topVer=3D-1, minorTopVer=3D0]<= /span>

2019-01-09 20:15:37,515 [exchange-worker-#44%TestNo= de-0%] WARN=C2=A0 org.apache.ignite.internal.diagnostic:118 - Last exchange= future: =E2=80=A6

2019-01-09 20:15:37,5= 15 [exchange-worker-#44%TestNode-0%] WARN=C2=A0 org.apache.ignite.internal.= processors.cache.GridCachePartitionExchangeManager:118 - First 10 pending e= xchange futures [total=3D0]

2019-01-09 20:15:37,51= 8 [exchange-worker-#44%TestNode-0%] WARN=C2=A0 org.apache.ignite.internal.d= iagnostic:118 - Last 10 exchange futures (total: 1):

<= p class=3DMsoNormal>2019-01-09 20:15:37,520 [exchange-worke= r-#44%TestNode-0%] WARN=C2=A0 org.apache.ignite.internal.diagnostic:118 - L= atch manager state: ExchangeLatchManager [serverLatches=3D{}, clientLatches= =3D{}]

2019-01-09 20:15:37,535 [exchange-worker-#1= 32%TestNode-2%] WARN=C2=A0 org.apache.ignite.internal.diagnostic:118 - Fail= ed to wait for partition map exchange [topVer=3DAffinityTopologyVersion [to= pVer=3D3, minorTopVer=3D1], node=3Da8e212dc-303e-4bc6-8bb6-fa2bc4c0478d]. D= umping pending objects that might be the cause:

2= 019-01-09 20:15:37,535 [exchange-worker-#132%TestNode-2%] WARN=C2=A0 org.ap= ache.ignite.internal.diagnostic:118 - Ready affinity version: AffinityTopol= ogyVersion [topVer=3D-1, minorTopVer=3D0]

2019-01-= 09 20:15:37,536 [exchange-worker-#132%TestNode-2%] WARN=C2=A0 org.apache.ig= nite.internal.diagnostic:118 - Last exchange future:

=

2019-01-09 20:15:37,537 [exchange-worker-#132%TestNode-2%] WARN=C2=A0 o= rg.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManage= r:118 - First 10 pending exchange futures [total=3D0]

=

2019-01-09 20:15:37,538 [exchange-worker-#132%TestNode-2%] WARN=C2=A0 o= rg.apache.ignite.internal.diagnostic:118 - Last 10 exchange futures (total:= 1):

2019-01-09 20:15:37,539 [exchange-worker-#132= %TestNode-2%] WARN=C2=A0 org.apache.ignite.internal.diagnostic:118 - >&g= t;> GridDhtPartitionsExchangeFuture [topVer=3DAffinityTopologyVersion [t= opVer=3D3, minorTopVer=3D1], evt=3DDISCOVERY_CUSTOM_EVT, evtNode=3DTcpDisco= veryNode [id=3D454d2051-cea6-4f2c-99a7-7c5698494175, addrs=3D[127.0.0.1], s= ockAddrs=3D[/127.0.0.1:47500], discPort=3D47500, order=3D1, intOrder=3D1, l= astExchangeTime=3D1547054124462, loc=3Dfalse, ver=3D2.7.0#20181130-sha1:256= ae401, isClient=3Dfalse], done=3Dfalse]

2019-01-09= 20:15:37,540 [exchange-worker-#132%TestNode-2%] WARN=C2=A0 org.apache.igni= te.internal.diagnostic:118 - Latch manager state: ExchangeLatchManager [ser= verLatches=3D{}, clientLatches=3D{}]

 

After that= , everything works fine, but it cause every test = to take more 10 seconds to run. And I am afraid t= o use it in prod before I understand problem.

 

Andrey.

 

= --_9B623BCE-B614-44BC-8B32-5F8B4488D171_--