spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From shahid qadri <shahidashr...@icloud.com>
Subject LARGE COLLECT
Date Mon, 26 Oct 2015 20:27:54 GMT
Hi Folks 

This might sound not apprioprate but i want to collect large data(15G approx).. and do some
processing on driver and broadcast that back to each nodes. Is there any option to collect
data off_heap.. like we can store  rdd off heap. 

i.e sort of collect data on tachyon FS... 


Mime
View raw message