ignite-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Denis Magda <dma...@gridgain.com>
Subject Re: Data Loading Performance Issue
Date Tue, 17 Nov 2015 06:45:41 GMT

Unfortunately I can't give you concrete recommendations because there are
tons of the reasons why your loading takes so long time.

Please clarify the following:

1) How big is the data set you're preloading?

2) What is your grid configuration? How many nodes are there? Attache Ignite
configuration you use to start the grid nodes.

3) You mentioned that you're getting the data from some DB. What kind of DB
are you working with? How do you connect to it from your local machine and
from remote machines? 

4) Preloading on the servers might work slower because the data is
transferred across network while in case of your local laptop the localhost
may be leveraged.
5) Measure the time that takes to load the data from DB. Probably this is
the slowest point.

6) Attache a snippet of your source code you use for data loading.

7) What is CPU load during the cache preloading on all the machines? What
kind of VM options do you use (heap size, kind of GC, etc.)


View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Data-Loading-Performance-Issue-tp1958p1982.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.

View raw message