From user-return-33518-archive-asf-public=cust-asf.ponee.io@ignite.apache.org Thu Apr 1 15:15:32 2021 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mxout1-ec2-va.apache.org (mxout1-ec2-va.apache.org [3.227.148.255]) by mx-eu-01.ponee.io (Postfix) with ESMTPS id 60D9A18065E for ; Thu, 1 Apr 2021 17:15:32 +0200 (CEST) Received: from mail.apache.org (mailroute1-lw-us.apache.org [207.244.88.153]) by mxout1-ec2-va.apache.org (ASF Mail Server at mxout1-ec2-va.apache.org) with SMTP id 80AA93F98C for ; Thu, 1 Apr 2021 15:15:31 +0000 (UTC) Received: (qmail 31190 invoked by uid 500); 1 Apr 2021 15:15:30 -0000 Mailing-List: contact user-help@ignite.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@ignite.apache.org Delivered-To: mailing list user@ignite.apache.org Received: (qmail 31180 invoked by uid 99); 1 Apr 2021 15:15:30 -0000 Received: from spamproc1-he-de.apache.org (HELO spamproc1-he-de.apache.org) (116.203.196.100) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 01 Apr 2021 15:15:30 +0000 Received: from localhost (localhost [127.0.0.1]) by spamproc1-he-de.apache.org (ASF Mail Server at spamproc1-he-de.apache.org) with ESMTP id 0843E1FF39B for ; Thu, 1 Apr 2021 15:15:30 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamproc1-he-de.apache.org X-Spam-Flag: NO X-Spam-Score: 0.004 X-Spam-Level: X-Spam-Status: No, score=0.004 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.2, NUMERIC_HTTP_ADDR=0.001, RCVD_IN_MSPIKE_H3=0.001, RCVD_IN_MSPIKE_WL=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001, WEIRD_PORT=0.001] autolearn=disabled Authentication-Results: spamproc1-he-de.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-ec2-va.apache.org ([116.203.227.195]) by localhost (spamproc1-he-de.apache.org [116.203.196.100]) (amavisd-new, port 10024) with ESMTP id hZ498Sc6jd9N for ; Thu, 1 Apr 2021 15:15:27 +0000 (UTC) Received-SPF: Pass (mailfrom) identity=mailfrom; client-ip=209.85.218.53; helo=mail-ej1-f53.google.com; envelope-from=ilya.kasnacheev@gmail.com; receiver= Received: from mail-ej1-f53.google.com (mail-ej1-f53.google.com [209.85.218.53]) by mx1-ec2-va.apache.org (ASF Mail Server at mx1-ec2-va.apache.org) with ESMTPS id 034FCBD8D5 for ; Thu, 1 Apr 2021 15:15:27 +0000 (UTC) Received: by mail-ej1-f53.google.com with SMTP id l4so3388201ejc.10 for ; Thu, 01 Apr 2021 08:15:26 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=LuiisXqZtU+JAabR6u8N0SuS2tCgH9fNXSRXUNi+bk4=; b=UzBfPTnImV2IHMYQIjPvqk0M+sYfcxDpw6yE15ZhNcqDQN0sTZIm+h1SZcvNNY2JTI WKof0hzLxImcY1pRTwYOihxsWNhfgl+rib9swfPy+5Yn4lcYtvAGGESiLX6ZhivlePRW YWt0hClxQEfPniYu/k03gQHbFSgQff7iPDgWbIMQXgijgW0GKGgcncmwImnXzmw5JgeT EFVSyQqII72efps7KEdhCMf3ydmJJJADPtOPzX8/24woetXrNWtuy/HHfI1JSNbOvY7S luouo+5q+MBphYWfNaxb7AXN82nvc7c1YweB2Fz4CjPUvqmhTwUmJUYVAwFwz3ZFhF8r XoCQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=LuiisXqZtU+JAabR6u8N0SuS2tCgH9fNXSRXUNi+bk4=; b=H0DizTxZqGn2d5631gDeLeG1MDwGzAF/hzBOu2s6HRQXowfh/7JFtrNHQ/Rh5vl2Ke I7hSV4uMjhZm3CJ9nsNda92CmRowtx/NjiXlQrtU2GweewNlFnA9bGFpvX6VNN/2UX6x vH5umrjwaXi8rW4cwZ4LqGjdew+TyOzV0vEbMEnXlodQQJTjjfv1/qME2mkraBMz0PO1 Scj9fnZT6voPAfq5HRnJ2KU9jh0VGBiAr5iVfbO3lo+2tvo9c0+8DxMyVkLl9wsW9wAx ivo14o5UAmFJLobqWZKFfSpgIQGnEfivAJZdSyyYUfSCA1z/cXL1buH4pIDMnPtQA+cx cWoA== X-Gm-Message-State: AOAM530ARrcXcb10zskgGWnjjlgIO8vTxKgCKjP0JRuoVAwYumTGUmo/ kIswUJSPRVLU1BtmKkuCnI8TrP8/WDPYK6QqLFb2Lvuy X-Google-Smtp-Source: ABdhPJw/v9rvlK23Zhqdn+NjB1/jljSbPgEK1iRDkUITJXJ4N9c81Lt4gdcpFff07+RYfriLwRo9KvV59MIsyis4nPk= X-Received: by 2002:a17:907:e88:: with SMTP id ho8mr9865918ejc.199.1617290125992; Thu, 01 Apr 2021 08:15:25 -0700 (PDT) MIME-Version: 1.0 References: <71100ce27bfa7711722fef8afc29a34e5c88968f.camel@nike.sk> <1617118815.481675962@f392.i.mail.ru> <196c73666d09f24145ce1a3b8ae84e6d0ccdf083.camel@nike.sk> <1617170461.720553817@f484.i.mail.ru> <39911b16dab4181badb0d8bbe6328fb8a2c59be8.camel@nike.sk> In-Reply-To: <39911b16dab4181badb0d8bbe6328fb8a2c59be8.camel@nike.sk> From: Ilya Kasnacheev Date: Thu, 1 Apr 2021 18:15:14 +0300 Message-ID: Subject: Re: Re[2]: Failed to write class name to file To: user@ignite.apache.org Content-Type: multipart/alternative; boundary="00000000000075689405beeab349" --00000000000075689405beeab349 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hello! In newer versions Ignite will never use /tmp by default. Regards, --=20 Ilya Kasnacheev =D1=81=D1=80, 31 =D0=BC=D0=B0=D1=80. 2021 =D0=B3. =D0=B2 13:26, Matej Kov= =C3=A1=C4=8D : > Thank you Zhenya, > it seems that the problem was caused by the fact that centos deleted the > whole ignite work directory as it was unaccessed for 10 days. > Ignite probably creates the workdir only when starting, but the > application did not restart during 2 weeks. It seems that Ignite failed t= o > serialize class because it assumed that the marshaller folder still exist= s. > > The solution is to never use /tmp for ignite workdir (or disable > tmpfiles.d). > > On Wed, 2021-03-31 at 09:01 +0300, Zhenya Stanilovsky wrote: > > > what output > of: stat /tmp/ignite-workspace/marshaller/-961185899.classname0 ? > If it`s all ok here, possibly some privileges issues ? > > > Hello, > > we are using CentOS Linux release 7.8.2003 (Core), which deletes files > from /tmp no sooner than 10 days after accessed, so this should not be an > issue. > > > On Tue, 2021-03-30 at 18:40 +0300, Zhenya Stanilovsky wrote: > > hi, > https://askubuntu.com/questions/20783/how-is-the-tmp-directory-cleaned-up > ? > > > > Hi, > > We use a cluster consisting of 2 Ignite nodes. Deployment is done without > downtime or cluster reset. > > When attempted to deploy new version of an application contaning new > caches on node 1, Ignite fails to write the class file on node 2. Peer > class loading is enabled. > The directory does exist and already contains other serialized classes an= d > has proper permissions. > > Somehow Ignite fails to open a file it has just created, with > FileNotFoundException: *No such file or directory* > Do you have any suggestions what could be the cause? > > Thank you, > Matej > > > [ERROR] [29.03.2021 14:34:09.686] [] [68.166.6:47500]-#2] > [i.i.MarshallerMappingFileStore]: Failed to write class name to file > [platformId=3D0id=3D-961185899, clsName=3Dorg.profile.AbTest, > file=3D/tmp/ignite-workspace/marshaller/-961185899.classname0] > java.io.FileNotFoundException: > /tmp/ignite-workspace/marshaller/-961185899.classname0 (No such file or > directory) > at java.base/java.io.FileOutputStream.open0(Native Method) > at java.base/java.io.FileOutputStream.open(FileOutputStream.java:298) > at java.base/java.io.FileOutputStream.(FileOutputStream.java:237) > at java.base/java.io.FileOutputStream.(FileOutputStream.java:187) > at > org.apache.ignite.internal.MarshallerMappingFileStore.writeMapping(Marsha= llerMappingFileStore.java:97) > at > org.apache.ignite.internal.MarshallerMappingFileStore.mergeAndWriteMappin= g(MarshallerMappingFileStore.java:222) > at > org.apache.ignite.internal.MarshallerContextImpl.onMappingDataReceived(Ma= rshallerContextImpl.java:191) > at > org.apache.ignite.internal.processors.marshaller.GridMarshallerMappingPro= cessor.processIncomingMappings(GridMarshallerMappingProcessor.java:356) > at > org.apache.ignite.internal.processors.marshaller.GridMarshallerMappingPro= cessor.onJoiningNodeDataReceived(GridMarshallerMappingProcessor.java:336) > at > org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$5.onEx= change(GridDiscoveryManager.java:906) > at > org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi.onExchange(TcpDiscove= rySpi.java:2090) > at > org.apache.ignite.spi.discovery.tcp.ServerImpl$RingMessageWorker.processN= odeAddedMessage(ServerImpl.java:4816) > at > org.apache.ignite.spi.discovery.tcp.ServerImpl$RingMessageWorker.processM= essage(ServerImpl.java:3089) > at > org.apache.ignite.spi.discovery.tcp.ServerImpl$RingMessageWorker.processM= essage(ServerImpl.java:2795) > at > org.apache.ignite.spi.discovery.tcp.ServerImpl$MessageWorker.body(ServerI= mpl.java:7766) > at > org.apache.ignite.spi.discovery.tcp.ServerImpl$RingMessageWorker.body(Ser= verImpl.java:2946) > at > org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:120= ) > at > org.apache.ignite.spi.discovery.tcp.ServerImpl$MessageWorkerThread.body(S= erverImpl.java:7697) > at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:61) > [ERROR] [29.03.2021 14:34:09.687] [] [68.166.6:47500]-#2] > [i.i.MarshallerMappingFileStore]: Failed to write class name to file > [platformId=3D0id=3D-1710898632, clsName=3Dorg.profile.GridCard, > file=3D/tmp/ignite-customer2/marshaller/-1710898632.classname0] > java.io.FileNotFoundException: > /tmp/ignite-customer2/marshaller/-1710898632.classname0 (No such file or > directory) > at java.base/java.io.FileOutputStream.open0(Native Method) > at java.base/java.io.FileOutputStream.open(FileOutputStream.java:298) > at java.base/java.io.FileOutputStream.(FileOutputStream.java:237) > at java.base/java.io.FileOutputStream.(FileOutputStream.java:187) > at > org.apache.ignite.internal.MarshallerMappingFileStore.writeMapping(Marsha= llerMappingFileStore.java:97) > at > org.apache.ignite.internal.MarshallerMappingFileStore.mergeAndWriteMappin= g(MarshallerMappingFileStore.java:222) > at > org.apache.ignite.internal.MarshallerContextImpl.onMappingDataReceived(Ma= rshallerContextImpl.java:191) > at > org.apache.ignite.internal.processors.marshaller.GridMarshallerMappingPro= cessor.processIncomingMappings(GridMarshallerMappingProcessor.java:356) > at > org.apache.ignite.internal.processors.marshaller.GridMarshallerMappingPro= cessor.onJoiningNodeDataReceived(GridMarshallerMappingProcessor.java:336) > at > org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$5.onEx= change(GridDiscoveryManager.java:906) > at > org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi.onExchange(TcpDiscove= rySpi.java:2090) > at > org.apache.ignite.spi.discovery.tcp.ServerImpl$RingMessageWorker.processN= odeAddedMessage(ServerImpl.java:4816) > at > org.apache.ignite.spi.discovery.tcp.ServerImpl$RingMessageWorker.processM= essage(ServerImpl.java:3089) > at > org.apache.ignite.spi.discovery.tcp.ServerImpl$RingMessageWorker.processM= essage(ServerImpl.java:2795) > at > org.apache.ignite.spi.discovery.tcp.ServerImpl$MessageWorker.body(ServerI= mpl.java:7766) > at > org.apache.ignite.spi.discovery.tcp.ServerImpl$RingMessageWorker.body(Ser= verImpl.java:2946) > at > org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:120= ) > at > org.apache.ignite.spi.discovery.tcp.ServerImpl$MessageWorkerThread.body(S= erverImpl.java:7697) > at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:61) > [ INFO] [29.03.2021 14:34:09.687] [] [68.166.6:47500]-#2] > [CacheObjectBinaryProcessorImpl]: New BinaryMetadata[typeId=3D-961185899, > typeName=3Dorg.profile.AbTest] is received from node > 70033db6-99a4-4dcf-b546-1206d3516b17; adding it locally > [ INFO] [29.03.2021 14:34:09.687] [] [68.166.6:47500]-#2] > [CacheObjectBinaryProcessorImpl]: New BinaryMetadata[typeId=3D-1710898632= , > typeName=3Dorg.profile.GridCard] is received from node > 70033db6-99a4-4dcf-b546-1206d3516b17; adding it locally > [ INFO] [29.03.2021 14:34:09.689] [] [68.166.6:47500]-#2] > [ o.a.i.s.d.t.TcpDiscoverySpi]: New next node [newNext=3DTcpDiscoveryNo= de > [id=3D70033db6-99a4-4dcf-b546-1206d3516b17, consistentId=3D127.0.0.1, > 192.168.166.163:47500, addrs=3DArrayList [127.0.0.1, 192.168.165.164], > sockAddrs=3DHashSet [/127.0.0.1:47500, prod-app27.dmn/192.168.165.164:475= 00], > discPort=3D47500, order=3D0, intOrder=3D18, lastExchangeTime=3D1617021249= 663, > loc=3Dfalse, ver=3D2.8.1#20200521-sha1:86422096, isClient=3Dfalse]] > [ INFO] [29.03.2021 14:34:09.738] [] [otifier-worker-#41] > [.p.c.GridClusterStateProcessor]: Received activate request with > BaselineTopology[id=3D0] > [ INFO] [29.03.2021 14:34:09.738] [] [otifier-worker-#41] > [.p.c.GridClusterStateProcessor]: Started state transition: true > [ INFO] [29.03.2021 14:34:09.738] [] [otifier-worker-#41] > [.p.c.GridClusterStateProcessor]: Received state change finish message: t= rue > [ INFO] [29.03.2021 14:34:09.738] [] [o-event-worker-#42] > [a.i.i.m.d.GridDiscoveryManager]: Added new node to topology: > TcpDiscoveryNode [id=3D70033db6-99a4-4dcf-b546-1206d3516b17, > consistentId=3D127.0.0.1,192.168.165.164:47500, addrs=3DArrayList [127.0.= 0.1, > 192.168.165.164], sockAddrs=3DHashSet [/127.0.0.1:47500, > prod-app27.dmn.sk/192.168.165.164:47500], discPort=3D47500, order=3D33, > intOrder=3D18, lastExchangeTime=3D1617021249663, loc=3Dfalse, > ver=3D2.8.1#20200521-sha1:86422096, isClient=3Dfalse] > [ INFO] [29.03.2021 14:34:09.738] [] [o-event-worker-#42] > [a.i.i.m.d.GridDiscoveryManager]: Topology snapshot [ver=3D33, > locNode=3D344660b0, servers=3D3, clients=3D0, state=3DACTIVE, CPUs=3D16, > offheap=3D11.0GB, heap=3D5.5GB] > [ INFO] [29.03.2021 14:34:09.738] [] [o-event-worker-#42] > [a.i.i.m.d.GridDiscoveryManager]: ^-- Baseline [id=3D0, size=3D3, onlin= e=3D3, > offline=3D0] > [ INFO] [29.03.2021 14:34:09.739] [] [xchange-worker-#43] > [ o.a.i.i.e.time]: Started exchange init > [topVer=3DAffinityTopologyVersion [topVer=3D33, minorTopVer=3D0], crd=3Df= alse, > evt=3DNODE_JOINED, evtNode=3D70033db6-99a4-4dcf-b546-1206d3516b17, > customEvt=3Dnull, allowMerge=3Dfalse, exchangeFreeSwitch=3Dfalse] > > > > > > > > > > > > --00000000000075689405beeab349 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hello!

In newer versions Ignite will ne= ver use /tmp by default.

Regards,
--
Ilya Kasnacheev


=D1=81=D1=80,= 31 =D0=BC=D0=B0=D1=80. 2021 =D0=B3. =D0=B2 13:26, Matej Kov=C3=A1=C4=8D &l= t;matej.kovac@nike.sk>:
Thank you Zhenya,=C2=A0
it seems that the problem was caused by the fact that centos deleted t= he whole ignite work directory as it was unaccessed for 10 days.=C2=A0
Ignite probably=C2=A0creates the workdir only when starting, but the a= pplication did not restart during 2 weeks. It seems that Ignite failed to s= erialize class because it assumed that the marshaller folder still exists.<= /div>

The solution is to never use /tmp for ignite workdir (or disable tmpfi= les.d).

On Wed, 2021-03-31 at 09:01 +0300, Zhenya Stanilovsky wrote:

what output of:=C2=A0stat=C2=A0/tmp/ignite-workspace/marshaller/-961185899.= classname0 ?=C2=A0
If it`s all ok here, possibly some privileges issues ?
=C2=A0

Hello,
=C2=A0
we are using=C2=A0CentOS Linux release 7.8.2003 (Core), which deletes = files from /tmp no sooner than 10 days after accessed, so this should not b= e an issue.
=C2=A0
=C2=A0
On Tue, 2021-03-30 at 18:40 +0300, Zhenya Stanilovsky wrote:
hi,
https://askubuntu.com/questions/20783/how-is-t= he-tmp-directory-cleaned-up ?

=C2=A0
Hi,=C2=A0
=C2=A0
We use a cluster consisting of 2 Ignite nodes. Deployment is done with= out downtime or cluster reset.
=C2=A0
When attempted to deploy new version of an application contaning new c= aches on node 1, Ignite fails to write the class file on node 2. Peer class= loading is enabled.=C2=A0
The directory does exist and already contains other serialized classes= and has proper permissions.
=C2=A0
Somehow Ignite fails to open a file it has just created, with FileNotF= oundException: No such file or directory
Do you have any suggestions what could be the cause?=C2=A0
=C2=A0
Thank you,
Matej
=C2=A0
=C2=A0
[ERROR] [29.03.2021 14:34:09.686] [] [68.166.6:47500]-#2] [i.i.Marshal= lerMappingFileStore]: Failed to write class name to file [platformId=3D0id= =3D-961185899, clsName=3Dorg.profile.AbTest, file=3D/tmp/ignite-workspace/m= arshaller/-961185899.classname0]
java.io.FileNotFoundException: /tmp/ignite-workspace/marshaller/-96118= 5899.classname0 (No such file or directory)
at java.base/java.io.FileOutputStream.open0(Native Method)
at java.base/java.io.FileOutputStream.open(FileOutputStream.java:298)<= /div>
at java.base/java.io.FileOutputStream.<init>(FileOutputStream.ja= va:237)
at java.base/java.io.FileOutputStream.<init>(FileOutputStream.ja= va:187)
at org.apache.ignite.internal.MarshallerMappingFileStore.writeMapping(= MarshallerMappingFileStore.java:97)
at org.apache.ignite.internal.MarshallerMappingFileStore.mergeAndWrite= Mapping(MarshallerMappingFileStore.java:222)
at org.apache.ignite.internal.MarshallerContextImpl.onMappingDataRecei= ved(MarshallerContextImpl.java:191)
at org.apache.ignite.internal.processors.marshaller.GridMarshallerMapp= ingProcessor.processIncomingMappings(GridMarshallerMappingProcessor.java:35= 6)
at org.apache.ignite.internal.processors.marshaller.GridMarshallerMapp= ingProcessor.onJoiningNodeDataReceived(GridMarshallerMappingProcessor.java:= 336)
at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$= 5.onExchange(GridDiscoveryManager.java:906)
at org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi.onExchange(TcpD= iscoverySpi.java:2090)
at org.apache.ignite.spi.discovery.tcp.ServerImpl$RingMessageWorker.pr= ocessNodeAddedMessage(ServerImpl.java:4816)
at org.apache.ignite.spi.discovery.tcp.ServerImpl$RingMessageWorker.pr= ocessMessage(ServerImpl.java:3089)
at org.apache.ignite.spi.discovery.tcp.ServerImpl$RingMessageWorker.pr= ocessMessage(ServerImpl.java:2795)
at org.apache.ignite.spi.discovery.tcp.ServerImpl$MessageWorker.body(S= erverImpl.java:7766)
at org.apache.ignite.spi.discovery.tcp.ServerImpl$RingMessageWorker.bo= dy(ServerImpl.java:2946)
at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.ja= va:120)
at org.apache.ignite.spi.discovery.tcp.ServerImpl$MessageWorkerThread.= body(ServerImpl.java:7697)
at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:61)<= /div>
[ERROR] [29.03.2021 14:34:09.687] [] [68.166.6:47500]-#2] [i.i.Marshal= lerMappingFileStore]: Failed to write class name to file [platformId=3D0id= =3D-1710898632, clsName=3Dorg.profile.GridCard, file=3D/tmp/ignite-customer= 2/marshaller/-1710898632.classname0]
java.io.FileNotFoundException: /tmp/ignite-customer2/marshaller/-17108= 98632.classname0 (No such file or directory)
at java.base/java.io.FileOutputStream.open0(Native Method)
at java.base/java.io.FileOutputStream.open(FileOutputStream.java:298)<= /div>
at java.base/java.io.FileOutputStream.<init>(FileOutputStream.ja= va:237)
at java.base/java.io.FileOutputStream.<init>(FileOutputStream.ja= va:187)
at org.apache.ignite.internal.MarshallerMappingFileStore.writeMapping(= MarshallerMappingFileStore.java:97)
at org.apache.ignite.internal.MarshallerMappingFileStore.mergeAndWrite= Mapping(MarshallerMappingFileStore.java:222)
at org.apache.ignite.internal.MarshallerContextImpl.onMappingDataRecei= ved(MarshallerContextImpl.java:191)
at org.apache.ignite.internal.processors.marshaller.GridMarshallerMapp= ingProcessor.processIncomingMappings(GridMarshallerMappingProcessor.java:35= 6)
at org.apache.ignite.internal.processors.marshaller.GridMarshallerMapp= ingProcessor.onJoiningNodeDataReceived(GridMarshallerMappingProcessor.java:= 336)
at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$= 5.onExchange(GridDiscoveryManager.java:906)
at org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi.onExchange(TcpD= iscoverySpi.java:2090)
at org.apache.ignite.spi.discovery.tcp.ServerImpl$RingMessageWorker.pr= ocessNodeAddedMessage(ServerImpl.java:4816)
at org.apache.ignite.spi.discovery.tcp.ServerImpl$RingMessageWorker.pr= ocessMessage(ServerImpl.java:3089)
at org.apache.ignite.spi.discovery.tcp.ServerImpl$RingMessageWorker.pr= ocessMessage(ServerImpl.java:2795)
at org.apache.ignite.spi.discovery.tcp.ServerImpl$MessageWorker.body(S= erverImpl.java:7766)
at org.apache.ignite.spi.discovery.tcp.ServerImpl$RingMessageWorker.bo= dy(ServerImpl.java:2946)
at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.ja= va:120)
at org.apache.ignite.spi.discovery.tcp.ServerImpl$MessageWorkerThread.= body(ServerImpl.java:7697)
at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:61)<= /div>
[ INFO] [29.03.2021 14:34:09.687] [] [68.166.6:47500]-#2] [CacheObject= BinaryProcessorImpl]: New BinaryMetadata[typeId=3D-961185899, typeName=3Dor= g.profile.AbTest] is received from node 70033db6-99a4-4dcf-b546-1206d3516b1= 7; adding it locally
[ INFO] [29.03.2021 14:34:09.687] [] [68.166.6:47500]-#2] [CacheObject= BinaryProcessorImpl]: New BinaryMetadata[typeId=3D-1710898632, typeName=3Do= rg.profile.GridCard] is received from node 70033db6-99a4-4dcf-b546-1206d351= 6b17; adding it locally
[ INFO] [29.03.2021 14:34:09.689] [] [68.166.6:47500]-#2] [=C2=A0=C2= =A0=C2=A0o.a.i.s.d.t.TcpDiscoverySpi]: New next node [newNext=3DTcpDiscover= yNode [id=3D70033db6-99a4-4dcf-b546-1206d3516b17, consistentId=3D127.0.0.1,= 192.168.166.163:= 47500, addrs=3DArrayList [127.0.0.1, 192.168.165.164], sockAddrs=3DHashSet [/127.0.0.1:47500, prod-app27.dmn/192.168.165.164:47500], discPort=3D47500, order=3D= 0, intOrder=3D18, lastExchangeTime=3D1617021249663, loc=3Dfalse, ver=3D2.8.= 1#20200521-sha1:86422096, isClient=3Dfalse]]
[ INFO] [29.03.2021 14:34:09.738] [] [otifier-worker-#41] [.p.c.GridCl= usterStateProcessor]: Received activate request with BaselineTopology[id=3D= 0]
[ INFO] [29.03.2021 14:34:09.738] [] [otifier-worker-#41] [.p.c.GridCl= usterStateProcessor]: Started state transition: true
[ INFO] [29.03.2021 14:34:09.738] [] [otifier-worker-#41] [.p.c.GridCl= usterStateProcessor]: Received state change finish message: true
[ INFO] [29.03.2021 14:34:09.738] [] [o-event-worker-#42] [a.i.i.m.d.G= ridDiscoveryManager]: Added new node to topology: TcpDiscoveryNode [id=3D70= 033db6-99a4-4dcf-b546-1206d3516b17, consistentId=3D127.0.0.1,192.168.165.164:47500, add= rs=3DArrayList [127.0.0.1, 192.168.165.164], sockAddrs=3DHashSet [/127.0.0.1:47500, prod-app27.dmn.sk/192.168.165.164= :47500], discPort=3D47500, order=3D33, intOrder=3D18, lastExchangeTime= =3D1617021249663, loc=3Dfalse, ver=3D2.8.1#20200521-sha1:86422096, isClient= =3Dfalse]
[ INFO] [29.03.2021 14:34:09.738] [] [o-event-worker-#42] [a.i.i.m.d.G= ridDiscoveryManager]: Topology snapshot [ver=3D33, locNode=3D344660b0, serv= ers=3D3, clients=3D0, state=3DACTIVE, CPUs=3D16, offheap=3D11.0GB, heap=3D5= .5GB]
[ INFO] [29.03.2021 14:34:09.738] [] [o-event-worker-#42] [a.i.i.m.d.G= ridDiscoveryManager]:=C2=A0=C2=A0=C2=A0^-- Baseline [id=3D0, size=3D3, onli= ne=3D3, offline=3D0]
[ INFO] [29.03.2021 14:34:09.739] [] [xchange-worker-#43] [=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0o.a.i.i.e.time]: Started exchange init [topVer=3DAffinityTopolo= gyVersion [topVer=3D33, minorTopVer=3D0], crd=3Dfalse, evt=3DNODE_JOINED, e= vtNode=3D70033db6-99a4-4dcf-b546-1206d3516b17, customEvt=3Dnull, allowMerge=3Dfalse, exchangeFreeSwitch=3Dfalse]
=C2=A0
=C2=A0
=C2=A0
=C2=A0
=C2=A0
=C2=A0
=C2=A0
=C2=A0
--00000000000075689405beeab349--