spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Xiaoyu Ma <hzmaxia...@corp.netease.com>
Subject Regarding Off-heap memory
Date Tue, 26 Jan 2016 12:20:24 GMT
Hi all,
I saw spark 1.6 has new off heap settings: spark.memory.offHeap.size
The doc said we need to shrink on heap size accordingly. But on Yarn on-heap and yarn limit
is set all together via spark.executor.memory (jvm opts for memory is not allowed according
to doc), how can we set executor JVM heap size and Yarn container memory limit differently?

Thanks.

马晓宇
hzmaxiaoyu@corp.netease.com




---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org


Mime
View raw message