carbondata-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From sun suzzy <suzzy20171...@hotmail.com>
Subject 答复: how to add RDD partition?
Date Tue, 27 Jun 2017 02:08:17 GMT
thanks

________________________________
发件人: Erlu Chen <chenerlu26@gmail.com>
发送时间: 2017年6月26日 14:42:20
收件人: user@carbondata.apache.org
主题: Re: how to add RDD partition?

Hi

please try to set spark.sql.shuffle.partitions or spark.default.parallelism
which can set task number.

spark.sql.shuffle.partitions is for spark sql.

spark.default.parallelism is for spark rdd.

Regards.
Chenerlu.





--
View this message in context: http://apache-carbondata-user-mailing-list.3231.n8.nabble.com/how-to-add-RDD-partition-tp31p32.html
Sent from the Apache CarbonData User Mailing List mailing list archive at Nabble.com.
Mime
View raw message