ignite-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From vkulichenko <valentin.kuliche...@gmail.com>
Subject Re: Super slow data loading performance when more nodes added
Date Mon, 24 Aug 2015 21:52:58 GMT

There are two ways to load large amounts of data into cache: using
IgniteDataStreamer and using CacheStore.loadCache method.

In case of IgniteDataStreamer you should start one client and read the whole
file there. It seems to me, the way you split will not give performance
improvement, because reading a line from local file is faster than updating
a remote node.

In case of CacheStore each node will have to read the whole file as well,
but it will save only data that belongs to the local node and discard
everything else, so there will be no network traffic at all during the

Please refer to this documentation page for more information and examples:

Let us know if you have more questions.


View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Super-slow-data-loading-performance-when-more-nodes-added-tp1105p1117.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.

View raw message