spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From GregBowyer <>
Subject Re: Interested in contributing to GraphX in Python
Date Wed, 17 Dec 2014 04:22:39 GMT
I have been thinking about this for a little while and I wonder if it makes
sense to look at forcing off heap mmap storage what can be shared with

The idea would be that java makes a DirectByteBuffer (or similar) with
python doing memoryview over that buffer.

Then for all except for real objects everything could be written in a numpy
friendly format into the mmap ?

View this message in context:
Sent from the Apache Spark Developers List mailing list archive at

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message