ignite-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Denis Magda (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (IGNITE-2835) BinaryObjectOffHeapImpl leaked to public code
Date Tue, 15 Mar 2016 12:17:33 GMT

     [ https://issues.apache.org/jira/browse/IGNITE-2835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Denis Magda updated IGNITE-2835:
--------------------------------
    Labels: community important  (was: )

> BinaryObjectOffHeapImpl leaked to public code
> ---------------------------------------------
>
>                 Key: IGNITE-2835
>                 URL: https://issues.apache.org/jira/browse/IGNITE-2835
>             Project: Ignite
>          Issue Type: Bug
>    Affects Versions: 1.5.0.final
>            Reporter: Denis Magda
>            Priority: Critical
>              Labels: community, important
>             Fix For: 1.6
>
>         Attachments: BinaryObjectOffHeapIssue.java
>
>
> To my knowledge {{BinaryObjectOffHeapImpl}} is considered to be used under some internal
lock only to prevent possible offheap pointer movement.
> However seems that we made it available to public code. If to start a partitioned cache
in {{OFFHEAP_TIRED}} mode, get {{BinaryObject}} from the cache inside of a TX and put the
same object back we will get exception like below
> {noformat}
> [15:00:00,892][WARN ][main][GridNearTxLocal] Set transaction invalidation flag to true
due to error [tx=GridNearTxLocal [mappings=IgniteTxMappingsImpl [], nearLocallyMapped=false,
colocatedLocallyMapped=true, needCheckBackup=null, hasRemoteLocks=false, mappings=IgniteTxMappingsImpl
[], super=GridDhtTxLocalAdapter [nearOnOriginatingNode=false, nearNodes=[], dhtNodes=[], explicitLock=false,
super=IgniteTxLocalAdapter [completedBase=null, sndTransformedVals=false, depEnabled=false,
txState=IgniteTxStateImpl [activeCacheIds=GridLongList [idx=1, arr=[-1206548976]], txMap={IgniteTxKey
[key=KeyCacheObjectImpl [val=0, hasValBytes=true], cacheId=-1206548976]=IgniteTxEntry [key=KeyCacheObjectImpl
[val=0, hasValBytes=true], cacheId=-1206548976, txKey=IgniteTxKey [key=KeyCacheObjectImpl
[val=0, hasValBytes=true], cacheId=-1206548976], val=[op=UPDATE, val=SomeType [idHash=1337835760,
hash=0, field2=name_0, field1=0]], prevVal=[op=UPDATE, val=SomeType [idHash=1337835760, hash=0,
field2=name_0, field1=0]], entryProcessorsCol=null, ttl=-1, conflictExpireTime=-1, conflictVer=null,
explicitVer=null, dhtVer=GridCacheVersion [topVer=69523200, nodeOrderDrId=1, globalTime=1458043200871,
order=1458043167489], filters=[], filtersPassed=false, filtersSet=true, entry=GridDhtColocatedCacheEntry
[super=GridDhtCacheEntry [rdrs=[], locPart=GridDhtLocalPartition [id=0, mapPubSize=0, rmvQueue=GridCircularBuffer
[sizeMask=255, idxGen=1], cntr=1, state=OWNING, reservations=0, empty=true, createTime=03/15/2016
15:00:00, mapPubSize=0], super=GridDistributedCacheEntry [super=GridCacheMapEntry [key=KeyCacheObjectImpl
[val=0, hasValBytes=true], val=null, startVer=1458043167488, ver=GridCacheVersion [topVer=69523200,
nodeOrderDrId=1, globalTime=1458043200890, order=1458043167490], hash=-1484017934, extras=GridCacheObsoleteEntryExtras
[obsoleteVer=GridCacheVersion [topVer=69523200, nodeOrderDrId=1, globalTime=1458043200890,
order=1458043167491]], flags=7]]]], prepared=false, locked=true, nodeId=993f5733-b014-4a5b-a6d1-934aeec9e9f5,
locMapped=false, expiryPlc=null, transferExpiryPlc=false, flags=2, partUpdateCntr=0, serReadVer=null,
xidVer=GridCacheVersion [topVer=69523200, nodeOrderDrId=1, globalTime=1458043200852, order=1458043167487]]}],
super=IgniteTxAdapter [xidVer=GridCacheVersion [topVer=69523200, nodeOrderDrId=1, globalTime=1458043200852,
order=1458043167487], writeVer=GridCacheVersion [topVer=69523200, nodeOrderDrId=1, globalTime=1458043200871,
order=1458043167489], implicit=false, loc=true, threadId=1, startTime=1458043200850, nodeId=993f5733-b014-4a5b-a6d1-934aeec9e9f5,
startVer=GridCacheVersion [topVer=69523200, nodeOrderDrId=1, globalTime=1458043200852, order=1458043167487],
endVer=null, isolation=REPEATABLE_READ, concurrency=PESSIMISTIC, timeout=0, sysInvalidate=true,
sys=false, plc=2, commitVer=GridCacheVersion [topVer=69523200, nodeOrderDrId=1, globalTime=1458043200852,
order=1458043167487], finalizing=NONE, preparing=false, invalidParts=null, state=UNKNOWN,
timedOut=false, topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], duration=40ms, onePhaseCommit=true],
size=1]]], err=class o.a.i.i.transactions.IgniteTxHeuristicCheckedException: Failed to locally
write to cache (all transaction entries will be invalidated, however there was a window when
entries for this transaction were visible to others): GridNearTxLocal [mappings=IgniteTxMappingsImpl
[], nearLocallyMapped=false, colocatedLocallyMapped=true, needCheckBackup=null, hasRemoteLocks=false,
mappings=IgniteTxMappingsImpl [], super=GridDhtTxLocalAdapter [nearOnOriginatingNode=false,
nearNodes=[], dhtNodes=[], explicitLock=false, super=IgniteTxLocalAdapter [completedBase=null,
sndTransformedVals=false, depEnabled=false, txState=IgniteTxStateImpl [activeCacheIds=GridLongList
[idx=1, arr=[-1206548976]], txMap={IgniteTxKey [key=KeyCacheObjectImpl [val=0, hasValBytes=true],
cacheId=-1206548976]=IgniteTxEntry [key=KeyCacheObjectImpl [val=0, hasValBytes=true], cacheId=-1206548976,
txKey=IgniteTxKey [key=KeyCacheObjectImpl [val=0, hasValBytes=true], cacheId=-1206548976],
val=[op=UPDATE, val=SomeType [idHash=1337835760, hash=0, field2=name_0, field1=0]], prevVal=[op=UPDATE,
val=SomeType [idHash=1337835760, hash=0, field2=name_0, field1=0]], entryProcessorsCol=null,
ttl=-1, conflictExpireTime=-1, conflictVer=null, explicitVer=null, dhtVer=GridCacheVersion
[topVer=69523200, nodeOrderDrId=1, globalTime=1458043200871, order=1458043167489], filters=[],
filtersPassed=false, filtersSet=true, entry=GridDhtColocatedCacheEntry [super=GridDhtCacheEntry
[rdrs=[], locPart=GridDhtLocalPartition [id=0, mapPubSize=1, rmvQueue=GridCircularBuffer [sizeMask=255,
idxGen=0], cntr=1, state=OWNING, reservations=0, empty=false, createTime=03/15/2016 15:00:00,
mapPubSize=1], super=GridDistributedCacheEntry [super=GridCacheMapEntry [key=KeyCacheObjectImpl
[val=0, hasValBytes=true], val=null, startVer=1458043167488, ver=GridCacheVersion [topVer=69523200,
nodeOrderDrId=1, globalTime=1458043200317, order=1458043162489], hash=-1484017934, extras=GridCacheMvccEntryExtras
[mvcc=GridCacheMvcc [locs=[GridCacheMvccCandidate [nodeId=993f5733-b014-4a5b-a6d1-934aeec9e9f5,
ver=GridCacheVersion [topVer=69523200, nodeOrderDrId=1, globalTime=1458043200852, order=1458043167487],
timeout=0, ts=1458043200860, threadId=1, id=1003, topVer=AffinityTopologyVersion [topVer=1,
minorTopVer=1], reentry=null, otherNodeId=993f5733-b014-4a5b-a6d1-934aeec9e9f5, otherVer=GridCacheVersion
[topVer=69523200, nodeOrderDrId=1, globalTime=1458043200852, order=1458043167487], mappedDhtNodes=null,
mappedNearNodes=null, ownerVer=null, serOrder=null, key=KeyCacheObjectImpl [val=0, hasValBytes=true],
masks=local=1|owner=1|ready=1|reentry=0|used=0|tx=1|single_implicit=0|dht_local=1|near_local=0|removed=0,
prevVer=null, nextVer=null]], rmts=null]], flags=6]]]], prepared=false, locked=true, nodeId=993f5733-b014-4a5b-a6d1-934aeec9e9f5,
locMapped=false, expiryPlc=null, transferExpiryPlc=false, flags=2, partUpdateCntr=0, serReadVer=null,
xidVer=GridCacheVersion [topVer=69523200, nodeOrderDrId=1, globalTime=1458043200852, order=1458043167487]]}],
super=IgniteTxAdapter [xidVer=GridCacheVersion [topVer=69523200, nodeOrderDrId=1, globalTime=1458043200852,
order=1458043167487], writeVer=GridCacheVersion [topVer=69523200, nodeOrderDrId=1, globalTime=1458043200871,
order=1458043167489], implicit=false, loc=true, threadId=1, startTime=1458043200850, nodeId=993f5733-b014-4a5b-a6d1-934aeec9e9f5,
startVer=GridCacheVersion [topVer=69523200, nodeOrderDrId=1, globalTime=1458043200852, order=1458043167487],
endVer=null, isolation=REPEATABLE_READ, concurrency=PESSIMISTIC, timeout=0, sysInvalidate=false,
sys=false, plc=2, commitVer=GridCacheVersion [topVer=69523200, nodeOrderDrId=1, globalTime=1458043200852,
order=1458043167487], finalizing=NONE, preparing=false, invalidParts=null, state=COMMITTING,
timedOut=false, topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], duration=20ms, onePhaseCommit=true],
size=1]]]]
> Exception in thread "main" class org.apache.ignite.transactions.TransactionHeuristicException:
Failed to locally write to cache (all transaction entries will be invalidated, however there
was a window when entries for this transaction were visible to others): GridNearTxLocal [mappings=IgniteTxMappingsImpl
[], nearLocallyMapped=false, colocatedLocallyMapped=true, needCheckBackup=null, hasRemoteLocks=false,
mappings=IgniteTxMappingsImpl [], super=GridDhtTxLocalAdapter [nearOnOriginatingNode=false,
nearNodes=[], dhtNodes=[], explicitLock=false, super=IgniteTxLocalAdapter [completedBase=null,
sndTransformedVals=false, depEnabled=false, txState=IgniteTxStateImpl [activeCacheIds=GridLongList
[idx=1, arr=[-1206548976]], txMap={IgniteTxKey [key=KeyCacheObjectImpl [val=0, hasValBytes=true],
cacheId=-1206548976]=IgniteTxEntry [key=KeyCacheObjectImpl [val=0, hasValBytes=true], cacheId=-1206548976,
txKey=IgniteTxKey [key=KeyCacheObjectImpl [val=0, hasValBytes=true], cacheId=-1206548976],
val=[op=UPDATE, val=SomeType [idHash=1337835760, hash=0, field2=name_0, field1=0]], prevVal=[op=UPDATE,
val=SomeType [idHash=1337835760, hash=0, field2=name_0, field1=0]], entryProcessorsCol=null,
ttl=-1, conflictExpireTime=-1, conflictVer=null, explicitVer=null, dhtVer=GridCacheVersion
[topVer=69523200, nodeOrderDrId=1, globalTime=1458043200871, order=1458043167489], filters=[],
filtersPassed=false, filtersSet=true, entry=GridDhtColocatedCacheEntry [super=GridDhtCacheEntry
[rdrs=[], locPart=GridDhtLocalPartition [id=0, mapPubSize=1, rmvQueue=GridCircularBuffer [sizeMask=255,
idxGen=0], cntr=1, state=OWNING, reservations=0, empty=false, createTime=03/15/2016 15:00:00,
mapPubSize=1], super=GridDistributedCacheEntry [super=GridCacheMapEntry [key=KeyCacheObjectImpl
[val=0, hasValBytes=true], val=null, startVer=1458043167488, ver=GridCacheVersion [topVer=69523200,
nodeOrderDrId=1, globalTime=1458043200317, order=1458043162489], hash=-1484017934, extras=GridCacheMvccEntryExtras
[mvcc=GridCacheMvcc [locs=[GridCacheMvccCandidate [nodeId=993f5733-b014-4a5b-a6d1-934aeec9e9f5,
ver=GridCacheVersion [topVer=69523200, nodeOrderDrId=1, globalTime=1458043200852, order=1458043167487],
timeout=0, ts=1458043200860, threadId=1, id=1003, topVer=AffinityTopologyVersion [topVer=1,
minorTopVer=1], reentry=null, otherNodeId=993f5733-b014-4a5b-a6d1-934aeec9e9f5, otherVer=GridCacheVersion
[topVer=69523200, nodeOrderDrId=1, globalTime=1458043200852, order=1458043167487], mappedDhtNodes=null,
mappedNearNodes=null, ownerVer=null, serOrder=null, key=KeyCacheObjectImpl [val=0, hasValBytes=true],
masks=local=1|owner=1|ready=1|reentry=0|used=0|tx=1|single_implicit=0|dht_local=1|near_local=0|removed=0,
prevVer=null, nextVer=null]], rmts=null]], flags=6]]]], prepared=false, locked=true, nodeId=993f5733-b014-4a5b-a6d1-934aeec9e9f5,
locMapped=false, expiryPlc=null, transferExpiryPlc=false, flags=2, partUpdateCntr=0, serReadVer=null,
xidVer=GridCacheVersion [topVer=69523200, nodeOrderDrId=1, globalTime=1458043200852, order=1458043167487]]}],
super=IgniteTxAdapter [xidVer=GridCacheVersion [topVer=69523200, nodeOrderDrId=1, globalTime=1458043200852,
order=1458043167487], writeVer=GridCacheVersion [topVer=69523200, nodeOrderDrId=1, globalTime=1458043200871,
order=1458043167489], implicit=false, loc=true, threadId=1, startTime=1458043200850, nodeId=993f5733-b014-4a5b-a6d1-934aeec9e9f5,
startVer=GridCacheVersion [topVer=69523200, nodeOrderDrId=1, globalTime=1458043200852, order=1458043167487],
endVer=null, isolation=REPEATABLE_READ, concurrency=PESSIMISTIC, timeout=0, sysInvalidate=false,
sys=false, plc=2, commitVer=GridCacheVersion [topVer=69523200, nodeOrderDrId=1, globalTime=1458043200852,
order=1458043167487], finalizing=NONE, preparing=false, invalidParts=null, state=COMMITTING,
timedOut=false, topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], duration=20ms, onePhaseCommit=true],
size=1]]]
> 	at org.apache.ignite.internal.util.IgniteUtils$11.apply(IgniteUtils.java:785)
> 	at org.apache.ignite.internal.util.IgniteUtils$11.apply(IgniteUtils.java:783)
> 	at org.apache.ignite.internal.util.IgniteUtils.convertException(IgniteUtils.java:877)
> 	at org.apache.ignite.internal.processors.cache.transactions.TransactionProxyImpl.commit(TransactionProxyImpl.java:264)
> 	at org.apache.ignite.examples.sber.BinaryObjectOffHeapIssue.main(BinaryObjectOffHeapIssue.java:60)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:497)
> 	at com.intellij.rt.execution.application.AppMain.main(AppMain.java:140)
> Caused by: class org.apache.ignite.internal.transactions.IgniteTxHeuristicCheckedException:
Failed to locally write to cache (all transaction entries will be invalidated, however there
was a window when entries for this transaction were visible to others): GridNearTxLocal [mappings=IgniteTxMappingsImpl
[], nearLocallyMapped=false, colocatedLocallyMapped=true, needCheckBackup=null, hasRemoteLocks=false,
mappings=IgniteTxMappingsImpl [], super=GridDhtTxLocalAdapter [nearOnOriginatingNode=false,
nearNodes=[], dhtNodes=[], explicitLock=false, super=IgniteTxLocalAdapter [completedBase=null,
sndTransformedVals=false, depEnabled=false, txState=IgniteTxStateImpl [activeCacheIds=GridLongList
[idx=1, arr=[-1206548976]], txMap={IgniteTxKey [key=KeyCacheObjectImpl [val=0, hasValBytes=true],
cacheId=-1206548976]=IgniteTxEntry [key=KeyCacheObjectImpl [val=0, hasValBytes=true], cacheId=-1206548976,
txKey=IgniteTxKey [key=KeyCacheObjectImpl [val=0, hasValBytes=true], cacheId=-1206548976],
val=[op=UPDATE, val=SomeType [idHash=1337835760, hash=0, field2=name_0, field1=0]], prevVal=[op=UPDATE,
val=SomeType [idHash=1337835760, hash=0, field2=name_0, field1=0]], entryProcessorsCol=null,
ttl=-1, conflictExpireTime=-1, conflictVer=null, explicitVer=null, dhtVer=GridCacheVersion
[topVer=69523200, nodeOrderDrId=1, globalTime=1458043200871, order=1458043167489], filters=[],
filtersPassed=false, filtersSet=true, entry=GridDhtColocatedCacheEntry [super=GridDhtCacheEntry
[rdrs=[], locPart=GridDhtLocalPartition [id=0, mapPubSize=1, rmvQueue=GridCircularBuffer [sizeMask=255,
idxGen=0], cntr=1, state=OWNING, reservations=0, empty=false, createTime=03/15/2016 15:00:00,
mapPubSize=1], super=GridDistributedCacheEntry [super=GridCacheMapEntry [key=KeyCacheObjectImpl
[val=0, hasValBytes=true], val=null, startVer=1458043167488, ver=GridCacheVersion [topVer=69523200,
nodeOrderDrId=1, globalTime=1458043200317, order=1458043162489], hash=-1484017934, extras=GridCacheMvccEntryExtras
[mvcc=GridCacheMvcc [locs=[GridCacheMvccCandidate [nodeId=993f5733-b014-4a5b-a6d1-934aeec9e9f5,
ver=GridCacheVersion [topVer=69523200, nodeOrderDrId=1, globalTime=1458043200852, order=1458043167487],
timeout=0, ts=1458043200860, threadId=1, id=1003, topVer=AffinityTopologyVersion [topVer=1,
minorTopVer=1], reentry=null, otherNodeId=993f5733-b014-4a5b-a6d1-934aeec9e9f5, otherVer=GridCacheVersion
[topVer=69523200, nodeOrderDrId=1, globalTime=1458043200852, order=1458043167487], mappedDhtNodes=null,
mappedNearNodes=null, ownerVer=null, serOrder=null, key=KeyCacheObjectImpl [val=0, hasValBytes=true],
masks=local=1|owner=1|ready=1|reentry=0|used=0|tx=1|single_implicit=0|dht_local=1|near_local=0|removed=0,
prevVer=null, nextVer=null]], rmts=null]], flags=6]]]], prepared=false, locked=true, nodeId=993f5733-b014-4a5b-a6d1-934aeec9e9f5,
locMapped=false, expiryPlc=null, transferExpiryPlc=false, flags=2, partUpdateCntr=0, serReadVer=null,
xidVer=GridCacheVersion [topVer=69523200, nodeOrderDrId=1, globalTime=1458043200852, order=1458043167487]]}],
super=IgniteTxAdapter [xidVer=GridCacheVersion [topVer=69523200, nodeOrderDrId=1, globalTime=1458043200852,
order=1458043167487], writeVer=GridCacheVersion [topVer=69523200, nodeOrderDrId=1, globalTime=1458043200871,
order=1458043167489], implicit=false, loc=true, threadId=1, startTime=1458043200850, nodeId=993f5733-b014-4a5b-a6d1-934aeec9e9f5,
startVer=GridCacheVersion [topVer=69523200, nodeOrderDrId=1, globalTime=1458043200852, order=1458043167487],
endVer=null, isolation=REPEATABLE_READ, concurrency=PESSIMISTIC, timeout=0, sysInvalidate=false,
sys=false, plc=2, commitVer=GridCacheVersion [topVer=69523200, nodeOrderDrId=1, globalTime=1458043200852,
order=1458043167487], finalizing=NONE, preparing=false, invalidParts=null, state=COMMITTING,
timedOut=false, topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], duration=20ms, onePhaseCommit=true],
size=1]]]
> 	at org.apache.ignite.internal.processors.cache.transactions.IgniteTxLocalAdapter.userCommit(IgniteTxLocalAdapter.java:1162)
> 	at org.apache.ignite.internal.processors.cache.distributed.near.GridNearTxLocal.finish(GridNearTxLocal.java:738)
> 	at org.apache.ignite.internal.processors.cache.distributed.near.GridNearTxFinishFuture.finish(GridNearTxFinishFuture.java:331)
> 	at org.apache.ignite.internal.processors.cache.distributed.near.GridNearTxLocal$4.apply(GridNearTxLocal.java:838)
> 	at org.apache.ignite.internal.processors.cache.distributed.near.GridNearTxLocal$4.apply(GridNearTxLocal.java:830)
> 	at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:262)
> 	at org.apache.ignite.internal.util.future.GridFutureAdapter.listen(GridFutureAdapter.java:225)
> 	at org.apache.ignite.internal.processors.cache.distributed.near.GridNearTxLocal.commitAsync(GridNearTxLocal.java:830)
> 	at org.apache.ignite.internal.processors.cache.GridCacheAdapter.commitTxAsync(GridCacheAdapter.java:4220)
> 	at org.apache.ignite.internal.processors.cache.GridCacheSharedContext.commitTxAsync(GridCacheSharedContext.java:619)
> 	at org.apache.ignite.internal.processors.cache.transactions.TransactionProxyImpl.commit(TransactionProxyImpl.java:256)
> 	... 6 more
> Caused by: java.lang.UnsupportedOperationException
> 	at org.apache.ignite.internal.binary.BinaryObjectOffheapImpl.prepareForCache(BinaryObjectOffheapImpl.java:358)
> 	at org.apache.ignite.internal.processors.cacheobject.IgniteCacheObjectProcessorImpl.prepareForCache(IgniteCacheObjectProcessorImpl.java:98)
> 	at org.apache.ignite.internal.processors.cache.GridCacheMapEntry.innerSet(GridCacheMapEntry.java:1182)
> 	at org.apache.ignite.internal.processors.cache.transactions.IgniteTxLocalAdapter.userCommit(IgniteTxLocalAdapter.java:1004)
> 	... 16 more
> {noformat}
> The test is attached.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message