ignite-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From okiesong <yjsong0...@gmail.com>
Subject loadCache is not returning the same number of records for every restart of the server
Date Thu, 26 Jul 2018 01:53:06 GMT
Hi, caheName.loadCache(null, "select * from sampledata") is not returning a
correct number of records every time, the record is fetched from Cassandra
table. 

My code generally looks like this;
caheName.loadCache(null, "select * from sampledata")

SqlFieldsQuery sqlQuery = new SqlFieldsQuery("select count(*) from
sampledata")  // this is under the assumption that our POJO class is also
called sampledata.

cacheName.query(sqlQuery); 

But above code works for small sets of data giving me the same number of
records counts, but with large sets of data(ex. 1,000,000), it is not
fetching all records, it gives me around 950,000-970,000 records although I
have allocated 10GB for memory after looking at
https://apacheignite.readme.io/docs/memory-configuration

But it was still no use. 

I have also taken a took a look at overwrite for DataStreamer, but it seems
with DataStreamer, I cannot call "select * from sampledata" which is from
Cassandra table that is connected to it, can someone give me some sample of
loading lots of data from Cassandra server to local node (instance) without
losing any records?

Thanks in advance!





--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Mime
View raw message