carbondata-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Erlu Chen <chenerl...@gmail.com>
Subject Re: how to add RDD partition?
Date Mon, 26 Jun 2017 06:42:20 GMT
Hi

please try to set spark.sql.shuffle.partitions or spark.default.parallelism
which can set task number.

spark.sql.shuffle.partitions is for spark sql.

spark.default.parallelism is for spark rdd.

Regards.
Chenerlu.





--
View this message in context: http://apache-carbondata-user-mailing-list.3231.n8.nabble.com/how-to-add-RDD-partition-tp31p32.html
Sent from the Apache CarbonData User Mailing List mailing list archive at Nabble.com.

Mime
View raw message