ignite-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From vkulichenko <valentin.kuliche...@gmail.com>
Subject Re: Number of partitions of IgniteRDD
Date Fri, 29 Apr 2016 21:09:05 GMT

This is because you're checking partitions for result DataFrame. IgniteRDD
queries Ignite directly, gets the result back and wraps it into the
DataFrame. If you do any transformations with this DataFrame, they are not
parallelized and are done on the driver. Thus only one partition returned.

To get correct number of partitions for IgniteRDD, do like this:



View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Number-of-partitions-of-IgniteRDD-tp4644p4708.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.

View raw message