ignite-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "tc_commenter (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (IGNITE-1239) Cache partition iterator throws exception when concurrent rebalancing is running
Date Thu, 13 Aug 2015 10:25:45 GMT

    [ https://issues.apache.org/jira/browse/IGNITE-1239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14695029#comment-14695029
] 

tc_commenter commented on IGNITE-1239:
--------------------------------------

There was triggered next test builds for last attached patch-file:
01. http://204.14.53.152/viewQueued.html?itemId=97603 - Ignite AOP
02. http://204.14.53.152/viewQueued.html?itemId=97604 - Ignite Basic
03. http://204.14.53.152/viewQueued.html?itemId=97605 - Ignite Cache
04. http://204.14.53.152/viewQueued.html?itemId=97606 - Ignite Cache 2
05. http://204.14.53.152/viewQueued.html?itemId=97607 - Ignite Cache 3
06. http://204.14.53.152/viewQueued.html?itemId=97608 - Ignite Cache 4
07. http://204.14.53.152/viewQueued.html?itemId=97609 - Ignite Cache Expiry Policy
08. http://204.14.53.152/viewQueued.html?itemId=97610 - Ignite Cache Failover
09. http://204.14.53.152/viewQueued.html?itemId=97611 - Ignite Cache Failover Multi JVM
10. http://204.14.53.152/viewQueued.html?itemId=97612 - Ignite Cache Failover2
11. http://204.14.53.152/viewQueued.html?itemId=97613 - Ignite Cache Full API
12. http://204.14.53.152/viewQueued.html?itemId=97614 - Ignite Cache Full API Multi JVM
13. http://204.14.53.152/viewQueued.html?itemId=97615 - Ignite Cache Restarts
14. http://204.14.53.152/viewQueued.html?itemId=97616 - Ignite Cache Tx Recovery
15. http://204.14.53.152/viewQueued.html?itemId=97617 - Ignite Cloud
16. http://204.14.53.152/viewQueued.html?itemId=97618 - Ignite Compute Grid
17. http://204.14.53.152/viewQueued.html?itemId=97619 - Ignite Data Strucutures
18. http://204.14.53.152/viewQueued.html?itemId=97620 - Ignite Examples
19. http://204.14.53.152/viewQueued.html?itemId=97621 - Ignite GCE
20. http://204.14.53.152/viewQueued.html?itemId=97622 - Ignite Geospacial Indexing
21. http://204.14.53.152/viewQueued.html?itemId=97623 - Ignite H2 Indexing
22. http://204.14.53.152/viewQueued.html?itemId=97624 - Ignite Hadoop
23. http://204.14.53.152/viewQueued.html?itemId=97625 - Ignite Hibernate
24. http://204.14.53.152/viewQueued.html?itemId=97626 - Ignite IGFS
25. http://204.14.53.152/viewQueued.html?itemId=97627 - Ignite IGFS Examples
26. http://204.14.53.152/viewQueued.html?itemId=97628 - Ignite IGFS Linux and MacOS
27. http://204.14.53.152/viewQueued.html?itemId=97629 - Ignite Java Client
28. http://204.14.53.152/viewQueued.html?itemId=97630 - Ignite JDBC Driver
29. http://204.14.53.152/viewQueued.html?itemId=97631 - Ignite JTA
30. http://204.14.53.152/viewQueued.html?itemId=97632 - Ignite Logging
31. http://204.14.53.152/viewQueued.html?itemId=97633 - Ignite Queries
32. http://204.14.53.152/viewQueued.html?itemId=97634 - Ignite Scalar Examples
33. http://204.14.53.152/viewQueued.html?itemId=97635 - Ignite SPI
34. http://204.14.53.152/viewQueued.html?itemId=97636 - Ignite Spring
35. http://204.14.53.152/viewQueued.html?itemId=97637 - Ignite Start Nodes
36. http://204.14.53.152/viewQueued.html?itemId=97638 - Ignite URI Deploy SPI
37. http://204.14.53.152/viewQueued.html?itemId=97639 - Ignite Visor Console
38. http://204.14.53.152/viewQueued.html?itemId=97640 - Ignite WebSessions
39. http://204.14.53.152/viewQueued.html?itemId=97641 - JCache TCK


> Cache partition iterator throws exception when concurrent rebalancing is running
> --------------------------------------------------------------------------------
>
>                 Key: IGNITE-1239
>                 URL: https://issues.apache.org/jira/browse/IGNITE-1239
>             Project: Ignite
>          Issue Type: Bug
>          Components: cache
>            Reporter: Alexey Goncharuk
>            Assignee: Denis Magda
>         Attachments: ignite-1239-2.patch, ignite-1239.patch
>
>
> I observed this exception when IgniteRDD was iterating over partition and two new nodes
have joined:
> {code}
> Caused by: class org.apache.ignite.IgniteCheckedException: Query execution failed: GridCacheQueryBean
[qry=GridCacheQueryAdapter [type=SCAN, clsName=null, clause=null, filter=org.apache.ignite.internal.processors.cache.IgniteCacheProxy$1@6490c94c,
part=138, incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=10, maxTime=10, avgTime=10.0,
execs=1, fails=1, executed=true], pageSize=1024, timeout=0, keepAll=true, incBackups=false,
dedup=false, prj=null, keepPortable=false, subjId=9cdc9751-c6ec-43eb-968a-e941f2a1a8cd, taskHash=0],
rdc=null, trans=null]
> 	at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.checkError(GridCacheQueryFutureAdapter.java:245)
> 	at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.internalIterator(GridCacheQueryFutureAdapter.java:303)
> 	at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.next(GridCacheQueryFutureAdapter.java:156)
> 	... 17 more
> Caused by: class org.apache.ignite.IgniteCheckedException: Failed to execute query on
node [query=GridCacheQueryBean [qry=GridCacheQueryAdapter [type=SCAN, clsName=null, clause=null,
filter=org.apache.ignite.internal.processors.cache.IgniteCacheProxy$1@6490c94c, part=138,
incMeta=false, metrics=GridCacheQueryMetricsAdapter [minTime=0, maxTime=0, avgTime=0.0, execs=0,
fails=0, executed=false], pageSize=1024, timeout=0, keepAll=true, incBackups=false, dedup=false,
prj=null, keepPortable=false, subjId=9cdc9751-c6ec-43eb-968a-e941f2a1a8cd, taskHash=0], rdc=null,
trans=null], nodeId=963d0e35-7805-4b6d-8d64-22cce84e35f2]
> 	at org.apache.ignite.internal.processors.cache.query.GridCacheQueryFutureAdapter.onPage(GridCacheQueryFutureAdapter.java:370)
> 	at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.processQueryResponse(GridCacheDistributedQueryManager.java:377)
> 	at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager.access$000(GridCacheDistributedQueryManager.java:44)
> 	at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$1.apply(GridCacheDistributedQueryManager.java:74)
> 	at org.apache.ignite.internal.processors.cache.query.GridCacheDistributedQueryManager$1.apply(GridCacheDistributedQueryManager.java:72)
> 	at org.apache.ignite.internal.processors.cache.GridCacheIoManager.processMessage(GridCacheIoManager.java:534)
> 	at org.apache.ignite.internal.processors.cache.GridCacheIoManager.onMessage0(GridCacheIoManager.java:240)
> 	at org.apache.ignite.internal.processors.cache.GridCacheIoManager.access$700(GridCacheIoManager.java:48)
> 	at org.apache.ignite.internal.processors.cache.GridCacheIoManager$OrderedMessageListener.onMessage(GridCacheIoManager.java:1026)
> 	at org.apache.ignite.internal.managers.communication.GridIoManager$GridCommunicationMessageSet.unwind(GridIoManager.java:2256)
> 	at org.apache.ignite.internal.managers.communication.GridIoManager.unwindMessageSet(GridIoManager.java:946)
> 	at org.apache.ignite.internal.managers.communication.GridIoManager.access$1700(GridIoManager.java:60)
> 	at org.apache.ignite.internal.managers.communication.GridIoManager$6.run(GridIoManager.java:915)
> 	... 3 more
> Caused by: class org.apache.ignite.IgniteCheckedException: Partition can't be reserved
> 	at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:6808)
> {code}
> The issue is that query request was sent on a backup node and by the time request has
arrived, the partition was already evicted, which resulted in "Partition cannot be reserved"
exception. We should automatically retry if this exception is encountered.
> I believe we have logic that retries, but it looks like there is a bug in that logic.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message