ignite-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From vkulichenko <valentin.kuliche...@gmail.com>
Subject Re: How to avoid data skew in collocate data with data
Date Wed, 26 Oct 2016 19:44:23 GMT

If you have such data distribution, then most likely your collocation
strategy is incorrect or at least not optimal. If your number of partitions
is much bigger than number of nodes and number of unique affinity keys is
much bigger than number of partitions, such skew will be minimized. "Much
bigger" here generally means orders of magnitude. Having said that, I would
recommend to revisit your data modes (in case this questions comes from a
real use case). Otherwise, you can always implement your own
AffinityFunction and customize data distribution, but this is not a trivial


View this message in context: http://apache-ignite-users.70518.x6.nabble.com/How-to-avoid-data-skew-in-collocate-data-with-data-tp8454p8518.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.

View raw message