From user-return-26827-archive-asf-public=cust-asf.ponee.io@ignite.apache.org Fri Aug 9 15:21:49 2019 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [207.244.88.153]) by mx-eu-01.ponee.io (Postfix) with SMTP id 11F6418063F for ; Fri, 9 Aug 2019 17:21:48 +0200 (CEST) Received: (qmail 12449 invoked by uid 500); 9 Aug 2019 15:21:42 -0000 Mailing-List: contact user-help@ignite.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@ignite.apache.org Delivered-To: mailing list user@ignite.apache.org Received: (qmail 12439 invoked by uid 99); 9 Aug 2019 15:21:42 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 09 Aug 2019 15:21:42 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 2A9C11A41A2 for ; Fri, 9 Aug 2019 15:21:42 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.803 X-Spam-Level: * X-Spam-Status: No, score=1.803 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=0.001, RCVD_IN_MSPIKE_WL=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-ec2-va.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id R7RG3wBmNFs9 for ; Fri, 9 Aug 2019 15:21:39 +0000 (UTC) Received-SPF: Pass (mailfrom) identity=mailfrom; client-ip=209.85.160.196; helo=mail-qt1-f196.google.com; envelope-from=andrey.davydov@gmail.com; receiver= Received: from mail-qt1-f196.google.com (mail-qt1-f196.google.com [209.85.160.196]) by mx1-ec2-va.apache.org (ASF Mail Server at mx1-ec2-va.apache.org) with ESMTPS id 26F26BC7B3 for ; Fri, 9 Aug 2019 15:21:39 +0000 (UTC) Received: by mail-qt1-f196.google.com with SMTP id 44so65078926qtg.11 for ; Fri, 09 Aug 2019 08:21:39 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=RoSY4XLSidH2sawBCAhPqw80VONGq1MkzhBQnH08pCs=; b=gvGTeM7j/zibD8oeiVNAZLyBNu1V+0i16pfaad+44+7S+2vv//hr7mEBUlojdlR1Be WWUj1ug4AJns0EUOEuTfmYjPElsudN+2xuSDmNYlBHDGArXOWIwus6kFjeR8B2r9Li2B druai6lmxjB75TYMGs+eT4o1ZB0B8a7RWjoSdTVFidLeX16iIjk9VA5avnWI0sLa+j8g iN/0CtOr/u2puyfCttMJ84i5PC3d3cxhwGHx0Rzqy7r4TWiEsaAE9dPL1RHF8tTMdSyB K7Ykbwst8mBRHxya/1y6RYLi3RsTbaVOLDkJjfqWjxvBqAI1ibbpjGwc16EZfgG2fdq/ wwFQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=RoSY4XLSidH2sawBCAhPqw80VONGq1MkzhBQnH08pCs=; b=NEj3CQ5WQKAslw4055kUa++VoRUMA9klhsSzSlH9MWU5UEdgGvefAVhpzUfWJcfrO7 G4dr1eiGUYmjq/5PvmjpKrUsgIFvCCpG/YUsJG+9aMJCAICHZHL17N+fjmLVcutNREHY +yuclDEyjcyBouvM5k74cx4C42KOv7zS4KKYz4g8O8oMg7vL2avQayE6qEWu8IXSfV5G 8O48ntmbjhtDXBP0J/ZMqpFHT9RJuI6uMxoeeHgJ0YWROZAGqrg+PkPSDBa1yULChTYg AOSXBS9lWOxNsZktx2yIWDvKuDUcf4pdgB8HSd+WTC81LcHgexQgj99IkvyjTrlUKhQZ O08Q== X-Gm-Message-State: APjAAAUBHCTdJovr6QRHEhMWWprZAcc6j/AM1YxbSXb4+QcCS6anCiYI yIw8eLm93kxJE5POPR3eNKwrDyhgAGlmZXx4zj4khC4/ X-Google-Smtp-Source: APXvYqyZuqtGJ3suDaG7GeU8fTUmMi4RxxdaUjKSyyP05F+xtv2Icf7snmf7z0RzUsQd0bEszAVNYmHMJ4bBuA76V+Q= X-Received: by 2002:ac8:70d1:: with SMTP id g17mr18672997qtp.124.1565364098535; Fri, 09 Aug 2019 08:21:38 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Andrey Davydov Date: Fri, 9 Aug 2019 18:21:31 +0300 Message-ID: Subject: Re: TimeoutException not wrapped in CacheException To: user@ignite.apache.org Content-Type: multipart/alternative; boundary="000000000000099571058fb0bb38" --000000000000099571058fb0bb38 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable As I see In javadocs for org.apache.ignite.transactions.Transaction /** * Commits this transaction by initiating {@code two-phase-commit} process. * * @throws IgniteException If commit failed. * @throws TransactionTimeoutException If transaction is timed out. * @throws TransactionRollbackException If transaction is automatically rolled back. * @throws TransactionOptimisticException If transaction concurrency is {@link TransactionConcurrency#OPTIMISTIC} * and commit is optimistically failed. * @throws TransactionHeuristicException If transaction has entered an unknown state. */ @IgniteAsyncSupported public void commit() throws IgniteException; And as we see in trace, exception come from org.apache.ignite.internal.processors.cache.transactions.TransactionPr= oxyImpl.commit So system behaviour meets javadoc but don't meet docs and example on https://apacheignite.readme.io/docs/transactions On Fri, Aug 9, 2019 at 6:12 PM Andrey Davydov wrote: > Sorry fo misprint, test does not check that there are no any way to get > TimeoutException > > On Fri, Aug 9, 2019 at 5:55 PM Andrey Davydov > wrote: > >> It is a little bit difficult to reproduce. We got unhadled exception on >> pre prod performance test of our system. I will try to reproduce it on >> weekend. >> >> You test just check that if you get CacheException then TimeoutException >> is inside it, but doesn't check that there are no any way to get >> CacheException. As I check listened in stack trace lines from 2.7.5 sour= ces >> (loaded from maven), i dont see where TOE shoud be wrapped to CE >> >> If there is full list of Exceptions when it is valid to retry transactio= n >> (Optimistic or Pessimistic). As I found in different pages of docs, now = I >> catch (optimistic tx): >> TransactionOptimisticException - try to rerun transaction >> ClusterTopologyException - retryReadyFuture().get() and try to rerun >> transaction >> CacheException check if getCause is Timeout then try to rerun or rethrow >> in other cases >> >> Thanks. >> >> On Fri, Aug 9, 2019 at 5:31 PM Andrei Aleksandrov < >> aealexsandrov@gmail.com> wrote: >> >>> Hi, >>> >>> It looks strange because even Ignite tests expect that >>> TransactionTimeoutException will be wrapped in CacheException. For >>> example IgniteTxConfigCacheSelfTest: >>> >>> try (final Transaction tx =3D ignite.transactions().txStart())= { >>> assert tx !=3D null; >>> >>> cache.put("key0", "val0"); >>> >>> sleepForTxFailure(); >>> >>> cache.put("key", "val"); >>> >>> fail("Timeout exception must be thrown"); >>> } >>> catch (CacheException e) { >>> assert e.getCause() instanceof TransactionTimeoutException= ; >>> } >>> >>> So could you please provide the reproducer for your issue? We will chec= k >>> it and create the JIRA for it. >>> >>> BR, >>> Andrei >>> >>> 8/9/2019 5:16 PM, Andrey Davydov =D0=BF=D0=B8=D1=88=D0=B5=D1=82: >>> > On ignite 2.7.5 I got TransactionTimeoutException not wrapped >>> > in CacheException. If it is normal behaviour and I should catch >>> > TransactionTimeoutException too. My current logic is to >>> > catch CacheException and check CacheException.getCause() if it >>> > was TransactionTimeoutException. >>> > >>> > Thanks. >>> > >>> > Full statck trace: >>> > >>> > Caused by: org.apache.ignite.transactions.TransactionTimeoutException= : >>> > Failed to acquire lock within provided timeout for transaction >>> > [timeout=3D150, tx=3DGridDhtTxLocal >>> > [nearNodeId=3D18e6b4a9-c39d-463a-9260-b5ed5057a491, >>> > nearFutId=3D74752d17c61-0341ea15-fcbd-48ef-b655-299a6d885196, >>> > nearMiniId=3D1, nearFinFutId=3Dnull, nearFinMiniId=3D0, >>> > nearXidVer=3DGridCacheVersion [topVer=3D176751246, order=3D1565274668= 396, >>> > nodeOrder=3D1], super=3DGridDhtTxLocalAdapter >>> > [nearOnOriginatingNode=3Dfalse, nearNodes=3D[], >>> > dhtNodes=3D[18e6b4a9-c39d-463a-9260-b5ed5057a491, >>> > 1144f759-6d1f-4aa3-9592-cc0b3481eb15], explicitLock=3Dfalse, >>> > super=3DIgniteTxLocalAdapter [completedBase=3Dnull, >>> > sndTransformedVals=3Dfalse, depEnabled=3Dfalse, txState=3DIgniteTxSta= teImpl >>> > [activeCacheIds=3D[1895344369], recovery=3Dfalse, mvccEnabled=3Dfalse= , >>> > txMap=3D[IgniteTxEntry [key=3DKeyCacheObjectImpl [part=3D127, >>> > val=3Dcancel_queue#FIRSTG, hasValBytes=3Dtrue], cacheId=3D1895344369, >>> > txKey=3DIgniteTxKey [key=3DKeyCacheObjectImpl [part=3D127, >>> > val=3Dcancel_queue#FIRSTG, hasValBytes=3Dtrue], cacheId=3D1895344369]= , >>> > val=3D[op=3DREAD, val=3Dnull], prevVal=3D[op=3DNOOP, val=3Dnull], old= Val=3D[op=3DNOOP, >>> > val=3Dnull], entryProcessorsCol=3Dnull, ttl=3D-1, conflictExpireTime= =3D-1, >>> > conflictVer=3Dnull, explicitVer=3Dnull, dhtVer=3Dnull, filters=3D[], >>> > filtersPassed=3Dfalse, filtersSet=3Dfalse, entry=3DGridDhtCacheEntry >>> > [rdrs=3D[], part=3D127, super=3DGridDistributedCacheEntry >>> > [super=3DGridCacheMapEntry [key=3DKeyCacheObjectImpl [part=3D127, >>> > val=3Dcancel_queue#FIRSTG, hasValBytes=3Dtrue], val=3Dnull, >>> > ver=3DGridCacheVersion [topVer=3D0, order=3D0, nodeOrder=3D0], >>> > hash=3D1903256846, extras=3DGridCacheMvccEntryExtras [mvcc=3DGridCach= eMvcc >>> > [locs=3D[GridCacheMvccCandidate >>> > [nodeId=3D73a0c88f-3628-4c12-bd75-d273b77a6752, ver=3DGridCacheVersio= n >>> > [topVer=3D176751246, order=3D1565274668397, nodeOrder=3D2], threadId= =3D883, >>> > id=3D412844, topVer=3DAffinityTopologyVersion [topVer=3D3, minorTopVe= r=3D1], >>> > reentry=3Dnull, otherNodeId=3D18e6b4a9-c39d-463a-9260-b5ed5057a491, >>> > otherVer=3DGridCacheVersion [topVer=3D176751246, order=3D156527466839= 6, >>> > nodeOrder=3D1], mappedDhtNodes=3Dnull, mappedNearNodes=3Dnull, >>> > ownerVer=3Dnull, serOrder=3DGridCacheVersion [topVer=3D176751246, >>> > order=3D1565274668396, nodeOrder=3D1], key=3DKeyCacheObjectImpl [part= =3D127, >>> > val=3Dcancel_queue#FIRSTG, hasValBytes=3Dtrue], >>> > >>> masks=3Dlocal=3D1|owner=3D1|ready=3D1|reentry=3D0|used=3D0|tx=3D1|singl= e_implicit=3D0|dht_local=3D1|near_local=3D0|removed=3D0|read=3D1, >>> >>> > prevVer=3DGridCacheVersion [topVer=3D176751246, order=3D1565274668397= , >>> > nodeOrder=3D2], nextVer=3Dnull]], rmts=3Dnull]], flags=3D2]]], prepar= ed=3D1, >>> > locked=3Dfalse, nodeId=3Dnull, locMapped=3Dfalse, expiryPlc=3Dnull, >>> > transferExpiryPlc=3Dfalse, flags=3D0, partUpdateCntr=3D0, >>> > serReadVer=3DGridCacheVersion [topVer=3D0, order=3D0, nodeOrder=3D0], >>> > xidVer=3Dnull], IgniteTxEntry [key=3DKeyCacheObjectImpl [part=3D121, >>> > val=3Dcancel_queue#FIRSTA, hasValBytes=3Dtrue], cacheId=3D1895344369, >>> > txKey=3DIgniteTxKey [key=3DKeyCacheObjectImpl [part=3D121, >>> > val=3Dcancel_queue#FIRSTA, hasValBytes=3Dtrue], cacheId=3D1895344369]= , >>> > val=3D[op=3DDELETE, val=3Dnull], prevVal=3D[op=3DNOOP, val=3Dnull], >>> > oldVal=3D[op=3DNOOP, val=3Dnull], entryProcessorsCol=3Dnull, ttl=3D-1= , >>> > conflictExpireTime=3D-1, conflictVer=3Dnull, explicitVer=3Dnull, >>> > dhtVer=3Dnull, filters=3D[], filtersPassed=3Dfalse, filtersSet=3Dfals= e, >>> > entry=3DGridDhtCacheEntry [rdrs=3D[], part=3D121, >>> > super=3DGridDistributedCacheEntry [super=3DGridCacheMapEntry >>> > [key=3DKeyCacheObjectImpl [part=3D121, val=3Dcancel_queue#FIRSTA, >>> > hasValBytes=3Dtrue], val=3Dnull, ver=3DGridCacheVersion [topVer=3D176= 751246, >>> > order=3D1565274668382, nodeOrder=3D2], hash=3D1903256840, >>> > extras=3DGridCacheMvccEntryExtras [mvcc=3DGridCacheMvcc >>> > [locs=3D[GridCacheMvccCandidate >>> > [nodeId=3D73a0c88f-3628-4c12-bd75-d273b77a6752, ver=3DGridCacheVersio= n >>> > [topVer=3D176751246, order=3D1565274668397, nodeOrder=3D2], threadId= =3D883, >>> > id=3D412843, topVer=3DAffinityTopologyVersion [topVer=3D3, minorTopVe= r=3D1], >>> > reentry=3Dnull, otherNodeId=3D18e6b4a9-c39d-463a-9260-b5ed5057a491, >>> > otherVer=3DGridCacheVersion [topVer=3D176751246, order=3D156527466839= 6, >>> > nodeOrder=3D1], mappedDhtNodes=3Dnull, mappedNearNodes=3Dnull, >>> > ownerVer=3Dnull, serOrder=3DGridCacheVersion [topVer=3D176751246, >>> > order=3D1565274668396, nodeOrder=3D1], key=3DKeyCacheObjectImpl [part= =3D121, >>> > val=3Dcancel_queue#FIRSTA, hasValBytes=3Dtrue], >>> > >>> masks=3Dlocal=3D1|owner=3D1|ready=3D1|reentry=3D0|used=3D0|tx=3D1|singl= e_implicit=3D0|dht_local=3D1|near_local=3D0|removed=3D0|read=3D0, >>> >>> > prevVer=3Dnull, nextVer=3DGridCacheVersion [topVer=3D176751246, >>> > order=3D1565274668397, nodeOrder=3D2]]], rmts=3Dnull]], flags=3D3]]], >>> > prepared=3D1, locked=3Dfalse, nodeId=3Dnull, locMapped=3Dfalse, >>> > expiryPlc=3Dnull, transferExpiryPlc=3Dfalse, flags=3D0, partUpdateCnt= r=3D0, >>> > serReadVer=3DGridCacheVersion [topVer=3D0, order=3D0, nodeOrder=3D0], >>> > xidVer=3Dnull]]], mvccWaitTxs=3Dnull, qryEnlisted=3Dfalse, >>> > forceSkipCompletedVers=3Dfalse, super=3DIgniteTxAdapter >>> > [xidVer=3DGridCacheVersion [topVer=3D176751246, order=3D1565274668397= , >>> > nodeOrder=3D2], writeVer=3DGridCacheVersion [topVer=3D176751246, >>> > order=3D1565274668398, nodeOrder=3D2], implicit=3Dfalse, loc=3Dtrue, >>> > threadId=3D883, startTime=3D1565337963940, >>> > nodeId=3D73a0c88f-3628-4c12-bd75-d273b77a6752, startVer=3DGridCacheVe= rsion >>> > [topVer=3D176751246, order=3D1565274668397, nodeOrder=3D2], endVer=3D= null, >>> > isolation=3DSERIALIZABLE, concurrency=3DOPTIMISTIC, timeout=3D150, >>> > sysInvalidate=3Dfalse, sys=3Dfalse, plc=3D2, commitVer=3Dnull, >>> > finalizing=3DNONE, invalidParts=3Dnull, state=3DPREPARING, timedOut= =3Dfalse, >>> > topVer=3DAffinityTopologyVersion [topVer=3D3, minorTopVer=3D1], >>> > txCounters=3Dnull, duration=3D152ms, onePhaseCommit=3Dfalse], size=3D= 2]]]] >>> > at >>> > >>> org.apache.ignite.internal.util.IgniteUtils$13.apply(IgniteUtils.java:9= 35) >>> > ~[ignite-core-2.7.5.jar:2.7.5] >>> > at >>> > >>> org.apache.ignite.internal.util.IgniteUtils$13.apply(IgniteUtils.java:9= 30) >>> > ~[ignite-core-2.7.5.jar:2.7.5] >>> > at >>> > >>> org.apache.ignite.internal.util.IgniteUtils.convertException(IgniteUtil= s.java:1021) >>> >>> > ~[ignite-core-2.7.5.jar:2.7.5] >>> > at >>> > >>> org.apache.ignite.internal.processors.cache.transactions.TransactionPro= xyImpl.commit(TransactionProxyImpl.java:305) >>> >>> > ~[ignite-core-2.7.5.jar:2.7.5] >>> > ... >>> > Caused by: >>> > >>> org.apache.ignite.internal.transactions.IgniteTxTimeoutCheckedException= : >>> > Failed to acquire lock within provided timeout for transaction >>> > [timeout=3D150, tx=3DGridDhtTxLocal >>> > [nearNodeId=3D18e6b4a9-c39d-463a-9260-b5ed5057a491, >>> > nearFutId=3D74752d17c61-0341ea15-fcbd-48ef-b655-299a6d885196, >>> > nearMiniId=3D1, nearFinFutId=3Dnull, nearFinMiniId=3D0, >>> > nearXidVer=3DGridCacheVersion [topVer=3D176751246, order=3D1565274668= 396, >>> > nodeOrder=3D1], super=3DGridDhtTxLocalAdapter >>> > [nearOnOriginatingNode=3Dfalse, nearNodes=3D[], >>> > dhtNodes=3D[18e6b4a9-c39d-463a-9260-b5ed5057a491, >>> > 1144f759-6d1f-4aa3-9592-cc0b3481eb15], explicitLock=3Dfalse, >>> > super=3DIgniteTxLocalAdapter [completedBase=3Dnull, >>> > sndTransformedVals=3Dfalse, depEnabled=3Dfalse, txState=3DIgniteTxSta= teImpl >>> > [activeCacheIds=3D[1895344369], recovery=3Dfalse, mvccEnabled=3Dfalse= , >>> > txMap=3D[IgniteTxEntry [key=3DKeyCacheObjectImpl [part=3D127, >>> > val=3Dcancel_queue#FIRSTG, hasValBytes=3Dtrue], cacheId=3D1895344369, >>> > txKey=3DIgniteTxKey [key=3DKeyCacheObjectImpl [part=3D127, >>> > val=3Dcancel_queue#FIRSTG, hasValBytes=3Dtrue], cacheId=3D1895344369]= , >>> > val=3D[op=3DREAD, val=3Dnull], prevVal=3D[op=3DNOOP, val=3Dnull], old= Val=3D[op=3DNOOP, >>> > val=3Dnull], entryProcessorsCol=3Dnull, ttl=3D-1, conflictExpireTime= =3D-1, >>> > conflictVer=3Dnull, explicitVer=3Dnull, dhtVer=3Dnull, filters=3D[], >>> > filtersPassed=3Dfalse, filtersSet=3Dfalse, entry=3DGridDhtCacheEntry >>> > [rdrs=3D[], part=3D127, super=3DGridDistributedCacheEntry >>> > [super=3DGridCacheMapEntry [key=3DKeyCacheObjectImpl [part=3D127, >>> > val=3Dcancel_queue#FIRSTG, hasValBytes=3Dtrue], val=3Dnull, >>> > ver=3DGridCacheVersion [topVer=3D0, order=3D0, nodeOrder=3D0], >>> > hash=3D1903256846, extras=3DGridCacheMvccEntryExtras [mvcc=3DGridCach= eMvcc >>> > [locs=3D[GridCacheMvccCandidate >>> > [nodeId=3D73a0c88f-3628-4c12-bd75-d273b77a6752, ver=3DGridCacheVersio= n >>> > [topVer=3D176751246, order=3D1565274668397, nodeOrder=3D2], threadId= =3D883, >>> > id=3D412844, topVer=3DAffinityTopologyVersion [topVer=3D3, minorTopVe= r=3D1], >>> > reentry=3Dnull, otherNodeId=3D18e6b4a9-c39d-463a-9260-b5ed5057a491, >>> > otherVer=3DGridCacheVersion [topVer=3D176751246, order=3D156527466839= 6, >>> > nodeOrder=3D1], mappedDhtNodes=3Dnull, mappedNearNodes=3Dnull, >>> > ownerVer=3Dnull, serOrder=3DGridCacheVersion [topVer=3D176751246, >>> > order=3D1565274668396, nodeOrder=3D1], key=3DKeyCacheObjectImpl [part= =3D127, >>> > val=3Dcancel_queue#FIRSTG, hasValBytes=3Dtrue], >>> > >>> masks=3Dlocal=3D1|owner=3D1|ready=3D1|reentry=3D0|used=3D0|tx=3D1|singl= e_implicit=3D0|dht_local=3D1|near_local=3D0|removed=3D0|read=3D1, >>> >>> > prevVer=3DGridCacheVersion [topVer=3D176751246, order=3D1565274668397= , >>> > nodeOrder=3D2], nextVer=3Dnull]], rmts=3Dnull]], flags=3D2]]], prepar= ed=3D1, >>> > locked=3Dfalse, nodeId=3Dnull, locMapped=3Dfalse, expiryPlc=3Dnull, >>> > transferExpiryPlc=3Dfalse, flags=3D0, partUpdateCntr=3D0, >>> > serReadVer=3DGridCacheVersion [topVer=3D0, order=3D0, nodeOrder=3D0], >>> > xidVer=3Dnull], IgniteTxEntry [key=3DKeyCacheObjectImpl [part=3D121, >>> > val=3Dcancel_queue#FIRSTA, hasValBytes=3Dtrue], cacheId=3D1895344369, >>> > txKey=3DIgniteTxKey [key=3DKeyCacheObjectImpl [part=3D121, >>> > val=3Dcancel_queue#FIRSTA, hasValBytes=3Dtrue], cacheId=3D1895344369]= , >>> > val=3D[op=3DDELETE, val=3Dnull], prevVal=3D[op=3DNOOP, val=3Dnull], >>> > oldVal=3D[op=3DNOOP, val=3Dnull], entryProcessorsCol=3Dnull, ttl=3D-1= , >>> > conflictExpireTime=3D-1, conflictVer=3Dnull, explicitVer=3Dnull, >>> > dhtVer=3Dnull, filters=3D[], filtersPassed=3Dfalse, filtersSet=3Dfals= e, >>> > entry=3DGridDhtCacheEntry [rdrs=3D[], part=3D121, >>> > super=3DGridDistributedCacheEntry [super=3DGridCacheMapEntry >>> > [key=3DKeyCacheObjectImpl [part=3D121, val=3Dcancel_queue#FIRSTA, >>> > hasValBytes=3Dtrue], val=3Dnull, ver=3DGridCacheVersion [topVer=3D176= 751246, >>> > order=3D1565274668382, nodeOrder=3D2], hash=3D1903256840, >>> > extras=3DGridCacheMvccEntryExtras [mvcc=3DGridCacheMvcc >>> > [locs=3D[GridCacheMvccCandidate >>> > [nodeId=3D73a0c88f-3628-4c12-bd75-d273b77a6752, ver=3DGridCacheVersio= n >>> > [topVer=3D176751246, order=3D1565274668397, nodeOrder=3D2], threadId= =3D883, >>> > id=3D412843, topVer=3DAffinityTopologyVersion [topVer=3D3, minorTopVe= r=3D1], >>> > reentry=3Dnull, otherNodeId=3D18e6b4a9-c39d-463a-9260-b5ed5057a491, >>> > otherVer=3DGridCacheVersion [topVer=3D176751246, order=3D156527466839= 6, >>> > nodeOrder=3D1], mappedDhtNodes=3Dnull, mappedNearNodes=3Dnull, >>> > ownerVer=3Dnull, serOrder=3DGridCacheVersion [topVer=3D176751246, >>> > order=3D1565274668396, nodeOrder=3D1], key=3DKeyCacheObjectImpl [part= =3D121, >>> > val=3Dcancel_queue#FIRSTA, hasValBytes=3Dtrue], >>> > >>> masks=3Dlocal=3D1|owner=3D1|ready=3D1|reentry=3D0|used=3D0|tx=3D1|singl= e_implicit=3D0|dht_local=3D1|near_local=3D0|removed=3D0|read=3D0, >>> >>> > prevVer=3Dnull, nextVer=3DGridCacheVersion [topVer=3D176751246, >>> > order=3D1565274668397, nodeOrder=3D2]]], rmts=3Dnull]], flags=3D3]]], >>> > prepared=3D1, locked=3Dfalse, nodeId=3Dnull, locMapped=3Dfalse, >>> > expiryPlc=3Dnull, transferExpiryPlc=3Dfalse, flags=3D0, partUpdateCnt= r=3D0, >>> > serReadVer=3DGridCacheVersion [topVer=3D0, order=3D0, nodeOrder=3D0], >>> > xidVer=3Dnull]]], mvccWaitTxs=3Dnull, qryEnlisted=3Dfalse, >>> > forceSkipCompletedVers=3Dfalse, super=3DIgniteTxAdapter >>> > [xidVer=3DGridCacheVersion [topVer=3D176751246, order=3D1565274668397= , >>> > nodeOrder=3D2], writeVer=3DGridCacheVersion [topVer=3D176751246, >>> > order=3D1565274668398, nodeOrder=3D2], implicit=3Dfalse, loc=3Dtrue, >>> > threadId=3D883, startTime=3D1565337963940, >>> > nodeId=3D73a0c88f-3628-4c12-bd75-d273b77a6752, startVer=3DGridCacheVe= rsion >>> > [topVer=3D176751246, order=3D1565274668397, nodeOrder=3D2], endVer=3D= null, >>> > isolation=3DSERIALIZABLE, concurrency=3DOPTIMISTIC, timeout=3D150, >>> > sysInvalidate=3Dfalse, sys=3Dfalse, plc=3D2, commitVer=3Dnull, >>> > finalizing=3DNONE, invalidParts=3Dnull, state=3DPREPARING, timedOut= =3Dfalse, >>> > topVer=3DAffinityTopologyVersion [topVer=3D3, minorTopVer=3D1], >>> > txCounters=3Dnull, duration=3D152ms, onePhaseCommit=3Dfalse], size=3D= 2]]]] >>> > at >>> > >>> org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtTxPr= epareFuture$PrepareTimeoutObject.onTimeout(GridDhtTxPrepareFuture.java:1983= ) >>> >>> > ~[ignite-core-2.7.5.jar:2.7.5] >>> > at >>> > >>> org.apache.ignite.internal.processors.timeout.GridTimeoutProcessor$Time= outWorker.body(GridTimeoutProcessor.java:234) >>> >>> > ~[ignite-core-2.7.5.jar:2.7.5] >>> > at >>> > >>> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:1= 20) >>> > ~[ignite-core-2.7.5.jar:2.7.5] >>> > ... 1 more >>> >> --000000000000099571058fb0bb38 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
As I see In javadocs for=C2=A0org.apache.ignite.transactio= ns.Transaction

=C2=A0 =C2=A0 /**
=C2=A0 =C2=A0 =C2=A0= * Commits this transaction by initiating {@code two-phase-commit} process.<= br>=C2=A0 =C2=A0 =C2=A0*
=C2=A0 =C2=A0 =C2=A0* @throws IgniteException I= f commit failed.
=C2=A0 =C2=A0 =C2=A0* @throws TransactionTimeoutExcepti= on If transaction is timed out.
=C2=A0 =C2=A0 =C2=A0* @throws Transactio= nRollbackException If transaction is automatically rolled back.
=C2=A0 = =C2=A0 =C2=A0* @throws TransactionOptimisticException If transaction concur= rency is {@link TransactionConcurrency#OPTIMISTIC}
=C2=A0 =C2=A0 =C2=A0*= and commit is optimistically failed.
=C2=A0 =C2=A0 =C2=A0* @throws Tran= sactionHeuristicException If transaction has entered an unknown state.
= =C2=A0 =C2=A0 =C2=A0*/
=C2=A0 =C2=A0 @IgniteAsyncSupported
=C2=A0 =C2= =A0 public void commit() throws IgniteException;

And as we see = in trace, exception come from=C2=A0org.apache.ignite.internal.processors.ca= che.transactions.TransactionProxyImpl.commit
So system behaviour = meets javadoc but don't meet docs and example on=C2=A0https://apacheignite.readme.io/= docs/transactions


On Fri, Aug 9, 2019 at = 6:12 PM Andrey Davydov <andr= ey.davydov@gmail.com> wrote:
Sorry fo misprint, test does not check= that there are no any way to get=C2=A0 TimeoutException=C2=A0

On Fri, Aug 9, 2019 at 5:55 PM Andrey Davydov <andrey.davydov@g= mail.com> wrote:
It is a little bit difficult to reproduce. We got = unhadled exception on pre prod performance test of our system. I will try t= o reproduce it on weekend.

You test just check that if y= ou get CacheException then TimeoutException is inside it, but doesn't c= heck that there are no any way to get CacheException. As I check listened i= n stack trace lines from 2.7.5 sources (loaded from maven), i dont see wher= e TOE shoud be wrapped to CE

If there is full list= of Exceptions when it is valid to retry transaction (Optimistic or Pessimi= stic). As I found in different pages of docs, now I catch (optimistic tx):<= /div>
TransactionOptimisticException - try to rerun transaction
ClusterTopologyException - retryReadyFuture().get() and try to rerun= transaction
CacheException check if getCause is Timeout then try= to rerun or rethrow in other cases

Thanks.
<= /div>
O= n Fri, Aug 9, 2019 at 5:31 PM Andrei Aleksandrov <aealexsandrov@gmail.com> wrot= e:
Hi,

It looks strange because even Ignite tests expect that
TransactionTimeoutException will be wrapped in=C2=A0CacheException. For example IgniteTxConfigCacheSelfTest:

=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 try (final Transaction tx = =3D ignite.transactions().txStart()) {
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 as= sert tx !=3D null;

=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 ca= che.put("key0", "val0");

=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 sl= eepForTxFailure();

=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 ca= che.put("key", "val");

=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 fa= il("Timeout exception must be thrown");
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 }
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 catch (CacheException e) {=
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 as= sert e.getCause() instanceof TransactionTimeoutException;
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 }

So could you please provide the reproducer for your issue? We will check it and create the JIRA for it.

BR,
Andrei

8/9/2019 5:16 PM, Andrey Davydov =D0=BF=D0=B8=D1=88=D0=B5=D1=82:
> On ignite 2.7.5 I got TransactionTimeoutException not wrapped
> in=C2=A0CacheException. If it is normal behaviour and I should catch <= br> > TransactionTimeoutException=C2=A0too. My current logic is to
> catch=C2=A0CacheException and check CacheException.getCause() if it > was=C2=A0TransactionTimeoutException.
>
> Thanks.
>
> Full statck trace:
>
> Caused by: org.apache.ignite.transactions.TransactionTimeoutException:=
> Failed to acquire lock within provided timeout for transaction
> [timeout=3D150, tx=3DGridDhtTxLocal
> [nearNodeId=3D18e6b4a9-c39d-463a-9260-b5ed5057a491,
> nearFutId=3D74752d17c61-0341ea15-fcbd-48ef-b655-299a6d885196,
> nearMiniId=3D1, nearFinFutId=3Dnull, nearFinMiniId=3D0,
> nearXidVer=3DGridCacheVersion [topVer=3D176751246, order=3D15652746683= 96,
> nodeOrder=3D1], super=3DGridDhtTxLocalAdapter
> [nearOnOriginatingNode=3Dfalse, nearNodes=3D[],
> dhtNodes=3D[18e6b4a9-c39d-463a-9260-b5ed5057a491,
> 1144f759-6d1f-4aa3-9592-cc0b3481eb15], explicitLock=3Dfalse,
> super=3DIgniteTxLocalAdapter [completedBase=3Dnull,
> sndTransformedVals=3Dfalse, depEnabled=3Dfalse, txState=3DIgniteTxStat= eImpl
> [activeCacheIds=3D[1895344369], recovery=3Dfalse, mvccEnabled=3Dfalse,=
> txMap=3D[IgniteTxEntry [key=3DKeyCacheObjectImpl [part=3D127,
> val=3Dcancel_queue#FIRSTG, hasValBytes=3Dtrue], cacheId=3D1895344369, =
> txKey=3DIgniteTxKey [key=3DKeyCacheObjectImpl [part=3D127,
> val=3Dcancel_queue#FIRSTG, hasValBytes=3Dtrue], cacheId=3D1895344369],=
> val=3D[op=3DREAD, val=3Dnull], prevVal=3D[op=3DNOOP, val=3Dnull], oldV= al=3D[op=3DNOOP,
> val=3Dnull], entryProcessorsCol=3Dnull, ttl=3D-1, conflictExpireTime= =3D-1,
> conflictVer=3Dnull, explicitVer=3Dnull, dhtVer=3Dnull, filters=3D[], <= br> > filtersPassed=3Dfalse, filtersSet=3Dfalse, entry=3DGridDhtCacheEntry <= br> > [rdrs=3D[], part=3D127, super=3DGridDistributedCacheEntry
> [super=3DGridCacheMapEntry [key=3DKeyCacheObjectImpl [part=3D127,
> val=3Dcancel_queue#FIRSTG, hasValBytes=3Dtrue], val=3Dnull,
> ver=3DGridCacheVersion [topVer=3D0, order=3D0, nodeOrder=3D0],
> hash=3D1903256846, extras=3DGridCacheMvccEntryExtras [mvcc=3DGridCache= Mvcc
> [locs=3D[GridCacheMvccCandidate
> [nodeId=3D73a0c88f-3628-4c12-bd75-d273b77a6752, ver=3DGridCacheVersion=
> [topVer=3D176751246, order=3D1565274668397, nodeOrder=3D2], threadId= =3D883,
> id=3D412844, topVer=3DAffinityTopologyVersion [topVer=3D3, minorTopVer= =3D1],
> reentry=3Dnull, otherNodeId=3D18e6b4a9-c39d-463a-9260-b5ed5057a491, > otherVer=3DGridCacheVersion [topVer=3D176751246, order=3D1565274668396= ,
> nodeOrder=3D1], mappedDhtNodes=3Dnull, mappedNearNodes=3Dnull,
> ownerVer=3Dnull, serOrder=3DGridCacheVersion [topVer=3D176751246,
> order=3D1565274668396, nodeOrder=3D1], key=3DKeyCacheObjectImpl [part= =3D127,
> val=3Dcancel_queue#FIRSTG, hasValBytes=3Dtrue],
> masks=3Dlocal=3D1|owner=3D1|ready=3D1|reentry=3D0|used=3D0|tx=3D1|sing= le_implicit=3D0|dht_local=3D1|near_local=3D0|removed=3D0|read=3D1,
> prevVer=3DGridCacheVersion [topVer=3D176751246, order=3D1565274668397,=
> nodeOrder=3D2], nextVer=3Dnull]], rmts=3Dnull]], flags=3D2]]], prepare= d=3D1,
> locked=3Dfalse, nodeId=3Dnull, locMapped=3Dfalse, expiryPlc=3Dnull, > transferExpiryPlc=3Dfalse, flags=3D0, partUpdateCntr=3D0,
> serReadVer=3DGridCacheVersion [topVer=3D0, order=3D0, nodeOrder=3D0], =
> xidVer=3Dnull], IgniteTxEntry [key=3DKeyCacheObjectImpl [part=3D121, <= br> > val=3Dcancel_queue#FIRSTA, hasValBytes=3Dtrue], cacheId=3D1895344369, =
> txKey=3DIgniteTxKey [key=3DKeyCacheObjectImpl [part=3D121,
> val=3Dcancel_queue#FIRSTA, hasValBytes=3Dtrue], cacheId=3D1895344369],=
> val=3D[op=3DDELETE, val=3Dnull], prevVal=3D[op=3DNOOP, val=3Dnull], > oldVal=3D[op=3DNOOP, val=3Dnull], entryProcessorsCol=3Dnull, ttl=3D-1,=
> conflictExpireTime=3D-1, conflictVer=3Dnull, explicitVer=3Dnull,
> dhtVer=3Dnull, filters=3D[], filtersPassed=3Dfalse, filtersSet=3Dfalse= ,
> entry=3DGridDhtCacheEntry [rdrs=3D[], part=3D121,
> super=3DGridDistributedCacheEntry [super=3DGridCacheMapEntry
> [key=3DKeyCacheObjectImpl [part=3D121, val=3Dcancel_queue#FIRSTA,
> hasValBytes=3Dtrue], val=3Dnull, ver=3DGridCacheVersion [topVer=3D1767= 51246,
> order=3D1565274668382, nodeOrder=3D2], hash=3D1903256840,
> extras=3DGridCacheMvccEntryExtras [mvcc=3DGridCacheMvcc
> [locs=3D[GridCacheMvccCandidate
> [nodeId=3D73a0c88f-3628-4c12-bd75-d273b77a6752, ver=3DGridCacheVersion=
> [topVer=3D176751246, order=3D1565274668397, nodeOrder=3D2], threadId= =3D883,
> id=3D412843, topVer=3DAffinityTopologyVersion [topVer=3D3, minorTopVer= =3D1],
> reentry=3Dnull, otherNodeId=3D18e6b4a9-c39d-463a-9260-b5ed5057a491, > otherVer=3DGridCacheVersion [topVer=3D176751246, order=3D1565274668396= ,
> nodeOrder=3D1], mappedDhtNodes=3Dnull, mappedNearNodes=3Dnull,
> ownerVer=3Dnull, serOrder=3DGridCacheVersion [topVer=3D176751246,
> order=3D1565274668396, nodeOrder=3D1], key=3DKeyCacheObjectImpl [part= =3D121,
> val=3Dcancel_queue#FIRSTA, hasValBytes=3Dtrue],
> masks=3Dlocal=3D1|owner=3D1|ready=3D1|reentry=3D0|used=3D0|tx=3D1|sing= le_implicit=3D0|dht_local=3D1|near_local=3D0|removed=3D0|read=3D0,
> prevVer=3Dnull, nextVer=3DGridCacheVersion [topVer=3D176751246,
> order=3D1565274668397, nodeOrder=3D2]]], rmts=3Dnull]], flags=3D3]]], =
> prepared=3D1, locked=3Dfalse, nodeId=3Dnull, locMapped=3Dfalse,
> expiryPlc=3Dnull, transferExpiryPlc=3Dfalse, flags=3D0, partUpdateCntr= =3D0,
> serReadVer=3DGridCacheVersion [topVer=3D0, order=3D0, nodeOrder=3D0], =
> xidVer=3Dnull]]], mvccWaitTxs=3Dnull, qryEnlisted=3Dfalse,
> forceSkipCompletedVers=3Dfalse, super=3DIgniteTxAdapter
> [xidVer=3DGridCacheVersion [topVer=3D176751246, order=3D1565274668397,=
> nodeOrder=3D2], writeVer=3DGridCacheVersion [topVer=3D176751246,
> order=3D1565274668398, nodeOrder=3D2], implicit=3Dfalse, loc=3Dtrue, <= br> > threadId=3D883, startTime=3D1565337963940,
> nodeId=3D73a0c88f-3628-4c12-bd75-d273b77a6752, startVer=3DGridCacheVer= sion
> [topVer=3D176751246, order=3D1565274668397, nodeOrder=3D2], endVer=3Dn= ull,
> isolation=3DSERIALIZABLE, concurrency=3DOPTIMISTIC, timeout=3D150, > sysInvalidate=3Dfalse, sys=3Dfalse, plc=3D2, commitVer=3Dnull,
> finalizing=3DNONE, invalidParts=3Dnull, state=3DPREPARING, timedOut=3D= false,
> topVer=3DAffinityTopologyVersion [topVer=3D3, minorTopVer=3D1],
> txCounters=3Dnull, duration=3D152ms, onePhaseCommit=3Dfalse], size=3D2= ]]]]
> at
> org.apache.ignite.internal.util.IgniteUtils$13.apply(IgniteUtils.java:= 935)
> ~[ignite-core-2.7.5.jar:2.7.5]
> at
> org.apache.ignite.internal.util.IgniteUtils$13.apply(IgniteUtils.java:= 930)
> ~[ignite-core-2.7.5.jar:2.7.5]
> at
> org.apache.ignite.internal.util.IgniteUtils.convertException(IgniteUti= ls.java:1021)
> ~[ignite-core-2.7.5.jar:2.7.5]
> at
> org.apache.ignite.internal.processors.cache.transactions.TransactionPr= oxyImpl.commit(TransactionProxyImpl.java:305)
> ~[ignite-core-2.7.5.jar:2.7.5]
> ...
> Caused by:
> org.apache.ignite.internal.transactions.IgniteTxTimeoutCheckedExceptio= n:
> Failed to acquire lock within provided timeout for transaction
> [timeout=3D150, tx=3DGridDhtTxLocal
> [nearNodeId=3D18e6b4a9-c39d-463a-9260-b5ed5057a491,
> nearFutId=3D74752d17c61-0341ea15-fcbd-48ef-b655-299a6d885196,
> nearMiniId=3D1, nearFinFutId=3Dnull, nearFinMiniId=3D0,
> nearXidVer=3DGridCacheVersion [topVer=3D176751246, order=3D15652746683= 96,
> nodeOrder=3D1], super=3DGridDhtTxLocalAdapter
> [nearOnOriginatingNode=3Dfalse, nearNodes=3D[],
> dhtNodes=3D[18e6b4a9-c39d-463a-9260-b5ed5057a491,
> 1144f759-6d1f-4aa3-9592-cc0b3481eb15], explicitLock=3Dfalse,
> super=3DIgniteTxLocalAdapter [completedBase=3Dnull,
> sndTransformedVals=3Dfalse, depEnabled=3Dfalse, txState=3DIgniteTxStat= eImpl
> [activeCacheIds=3D[1895344369], recovery=3Dfalse, mvccEnabled=3Dfalse,=
> txMap=3D[IgniteTxEntry [key=3DKeyCacheObjectImpl [part=3D127,
> val=3Dcancel_queue#FIRSTG, hasValBytes=3Dtrue], cacheId=3D1895344369, =
> txKey=3DIgniteTxKey [key=3DKeyCacheObjectImpl [part=3D127,
> val=3Dcancel_queue#FIRSTG, hasValBytes=3Dtrue], cacheId=3D1895344369],=
> val=3D[op=3DREAD, val=3Dnull], prevVal=3D[op=3DNOOP, val=3Dnull], oldV= al=3D[op=3DNOOP,
> val=3Dnull], entryProcessorsCol=3Dnull, ttl=3D-1, conflictExpireTime= =3D-1,
> conflictVer=3Dnull, explicitVer=3Dnull, dhtVer=3Dnull, filters=3D[], <= br> > filtersPassed=3Dfalse, filtersSet=3Dfalse, entry=3DGridDhtCacheEntry <= br> > [rdrs=3D[], part=3D127, super=3DGridDistributedCacheEntry
> [super=3DGridCacheMapEntry [key=3DKeyCacheObjectImpl [part=3D127,
> val=3Dcancel_queue#FIRSTG, hasValBytes=3Dtrue], val=3Dnull,
> ver=3DGridCacheVersion [topVer=3D0, order=3D0, nodeOrder=3D0],
> hash=3D1903256846, extras=3DGridCacheMvccEntryExtras [mvcc=3DGridCache= Mvcc
> [locs=3D[GridCacheMvccCandidate
> [nodeId=3D73a0c88f-3628-4c12-bd75-d273b77a6752, ver=3DGridCacheVersion=
> [topVer=3D176751246, order=3D1565274668397, nodeOrder=3D2], threadId= =3D883,
> id=3D412844, topVer=3DAffinityTopologyVersion [topVer=3D3, minorTopVer= =3D1],
> reentry=3Dnull, otherNodeId=3D18e6b4a9-c39d-463a-9260-b5ed5057a491, > otherVer=3DGridCacheVersion [topVer=3D176751246, order=3D1565274668396= ,
> nodeOrder=3D1], mappedDhtNodes=3Dnull, mappedNearNodes=3Dnull,
> ownerVer=3Dnull, serOrder=3DGridCacheVersion [topVer=3D176751246,
> order=3D1565274668396, nodeOrder=3D1], key=3DKeyCacheObjectImpl [part= =3D127,
> val=3Dcancel_queue#FIRSTG, hasValBytes=3Dtrue],
> masks=3Dlocal=3D1|owner=3D1|ready=3D1|reentry=3D0|used=3D0|tx=3D1|sing= le_implicit=3D0|dht_local=3D1|near_local=3D0|removed=3D0|read=3D1,
> prevVer=3DGridCacheVersion [topVer=3D176751246, order=3D1565274668397,=
> nodeOrder=3D2], nextVer=3Dnull]], rmts=3Dnull]], flags=3D2]]], prepare= d=3D1,
> locked=3Dfalse, nodeId=3Dnull, locMapped=3Dfalse, expiryPlc=3Dnull, > transferExpiryPlc=3Dfalse, flags=3D0, partUpdateCntr=3D0,
> serReadVer=3DGridCacheVersion [topVer=3D0, order=3D0, nodeOrder=3D0], =
> xidVer=3Dnull], IgniteTxEntry [key=3DKeyCacheObjectImpl [part=3D121, <= br> > val=3Dcancel_queue#FIRSTA, hasValBytes=3Dtrue], cacheId=3D1895344369, =
> txKey=3DIgniteTxKey [key=3DKeyCacheObjectImpl [part=3D121,
> val=3Dcancel_queue#FIRSTA, hasValBytes=3Dtrue], cacheId=3D1895344369],=
> val=3D[op=3DDELETE, val=3Dnull], prevVal=3D[op=3DNOOP, val=3Dnull], > oldVal=3D[op=3DNOOP, val=3Dnull], entryProcessorsCol=3Dnull, ttl=3D-1,=
> conflictExpireTime=3D-1, conflictVer=3Dnull, explicitVer=3Dnull,
> dhtVer=3Dnull, filters=3D[], filtersPassed=3Dfalse, filtersSet=3Dfalse= ,
> entry=3DGridDhtCacheEntry [rdrs=3D[], part=3D121,
> super=3DGridDistributedCacheEntry [super=3DGridCacheMapEntry
> [key=3DKeyCacheObjectImpl [part=3D121, val=3Dcancel_queue#FIRSTA,
> hasValBytes=3Dtrue], val=3Dnull, ver=3DGridCacheVersion [topVer=3D1767= 51246,
> order=3D1565274668382, nodeOrder=3D2], hash=3D1903256840,
> extras=3DGridCacheMvccEntryExtras [mvcc=3DGridCacheMvcc
> [locs=3D[GridCacheMvccCandidate
> [nodeId=3D73a0c88f-3628-4c12-bd75-d273b77a6752, ver=3DGridCacheVersion=
> [topVer=3D176751246, order=3D1565274668397, nodeOrder=3D2], threadId= =3D883,
> id=3D412843, topVer=3DAffinityTopologyVersion [topVer=3D3, minorTopVer= =3D1],
> reentry=3Dnull, otherNodeId=3D18e6b4a9-c39d-463a-9260-b5ed5057a491, > otherVer=3DGridCacheVersion [topVer=3D176751246, order=3D1565274668396= ,
> nodeOrder=3D1], mappedDhtNodes=3Dnull, mappedNearNodes=3Dnull,
> ownerVer=3Dnull, serOrder=3DGridCacheVersion [topVer=3D176751246,
> order=3D1565274668396, nodeOrder=3D1], key=3DKeyCacheObjectImpl [part= =3D121,
> val=3Dcancel_queue#FIRSTA, hasValBytes=3Dtrue],
> masks=3Dlocal=3D1|owner=3D1|ready=3D1|reentry=3D0|used=3D0|tx=3D1|sing= le_implicit=3D0|dht_local=3D1|near_local=3D0|removed=3D0|read=3D0,
> prevVer=3Dnull, nextVer=3DGridCacheVersion [topVer=3D176751246,
> order=3D1565274668397, nodeOrder=3D2]]], rmts=3Dnull]], flags=3D3]]], =
> prepared=3D1, locked=3Dfalse, nodeId=3Dnull, locMapped=3Dfalse,
> expiryPlc=3Dnull, transferExpiryPlc=3Dfalse, flags=3D0, partUpdateCntr= =3D0,
> serReadVer=3DGridCacheVersion [topVer=3D0, order=3D0, nodeOrder=3D0], =
> xidVer=3Dnull]]], mvccWaitTxs=3Dnull, qryEnlisted=3Dfalse,
> forceSkipCompletedVers=3Dfalse, super=3DIgniteTxAdapter
> [xidVer=3DGridCacheVersion [topVer=3D176751246, order=3D1565274668397,=
> nodeOrder=3D2], writeVer=3DGridCacheVersion [topVer=3D176751246,
> order=3D1565274668398, nodeOrder=3D2], implicit=3Dfalse, loc=3Dtrue, <= br> > threadId=3D883, startTime=3D1565337963940,
> nodeId=3D73a0c88f-3628-4c12-bd75-d273b77a6752, startVer=3DGridCacheVer= sion
> [topVer=3D176751246, order=3D1565274668397, nodeOrder=3D2], endVer=3Dn= ull,
> isolation=3DSERIALIZABLE, concurrency=3DOPTIMISTIC, timeout=3D150, > sysInvalidate=3Dfalse, sys=3Dfalse, plc=3D2, commitVer=3Dnull,
> finalizing=3DNONE, invalidParts=3Dnull, state=3DPREPARING, timedOut=3D= false,
> topVer=3DAffinityTopologyVersion [topVer=3D3, minorTopVer=3D1],
> txCounters=3Dnull, duration=3D152ms, onePhaseCommit=3Dfalse], size=3D2= ]]]]
> at
> org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtTxP= repareFuture$PrepareTimeoutObject.onTimeout(GridDhtTxPrepareFuture.java:198= 3)
> ~[ignite-core-2.7.5.jar:2.7.5]
> at
> org.apache.ignite.internal.processors.timeout.GridTimeoutProcessor$Tim= eoutWorker.body(GridTimeoutProcessor.java:234)
> ~[ignite-core-2.7.5.jar:2.7.5]
> at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:= 120)
> ~[ignite-core-2.7.5.jar:2.7.5]
> ... 1 more
--000000000000099571058fb0bb38--