ignite-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From soroka21 <sorok...@gmail.com>
Subject Re: SQL Count(*) returns incorrect count
Date Wed, 29 Nov 2017 19:14:50 GMT
Switched to Ignite 2.3.0 in hope it has better behavior.
Unfortunately it is not.

During the execution of Spark job number of cache rows is growing but after
Spark job completes - looks like some entries has been removed.
JavaIgniteRDD shows correct count but again final result is incorrect.

I was using sqlline to track count of record during Spark job execution - it
shows some problem also:

0: jdbc:ignite:thin://10.238.42.86/> select count(*) from data3;
+--------------------------------+
|            COUNT(*)            |
+--------------------------------+
| 6428                           |
+--------------------------------+
1 row selected (0.063 seconds)
0: jdbc:ignite:thin://10.238.42.86/> select count(*) from data3;
+--------------------------------+
|            COUNT(*)            |
+--------------------------------+
| 62501                          |
+--------------------------------+
1 row selected (0.096 seconds)
0: jdbc:ignite:thin://10.238.42.86/> select count(*) from data3;
+--------------------------------+
|            COUNT(*)            |
+--------------------------------+
| 268183                         |
+--------------------------------+
1 row selected (0.154 seconds)
0: jdbc:ignite:thin://10.238.42.86/> select count(*) from data3;
+--------------------------------+
|            COUNT(*)            |
+--------------------------------+
| 482616                         |
+--------------------------------+
1 row selected (0.159 seconds)
0: jdbc:ignite:thin://10.238.42.86/> select count(*) from data3;
+--------------------------------+
|            COUNT(*)            |
+--------------------------------+
| 722436                         |
+--------------------------------+
1 row selected (0.159 seconds)
0: jdbc:ignite:thin://10.238.42.86/> select count(*) from data3;
+--------------------------------+
|            COUNT(*)            |
+--------------------------------+
| 1017236                        |             <---------------------------
Still looks good here
+--------------------------------+
1 row selected (0.205 seconds)
0: jdbc:ignite:thin://10.238.42.86/> select count(*) from data3;
+--------------------------------+
|            COUNT(*)            |
+--------------------------------+
| 542535                         |        <---------------------------
Ooops!
+--------------------------------+






--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Mime
View raw message