spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Nathan Kronenfeld <nkronenf...@oculusinfo.com>
Subject Re: persistence state of an RDD
Date Tue, 15 Jul 2014 15:14:51 GMT
Thanks


On Tue, Jul 15, 2014 at 10:39 AM, Praveen Seluka <pseluka@qubole.com> wrote:

> Nathan, you are looking for SparkContext.getRDDStorageInfo which returns
> the information on how much is cached.
>
>
> On Tue, Jul 15, 2014 at 8:01 PM, Nathan Kronenfeld <
> nkronenfeld@oculusinfo.com> wrote:
>
>> Is there a way of determining programatically the cache state of an RDD?
>> Not its storage level, but how much of it is actually cached?
>>
>> Thanks,
>>                     -Nathan
>>
>>
>>
>>
>>
>> --
>> Nathan Kronenfeld
>> Senior Visualization Developer
>> Oculus Info Inc
>> 2 Berkeley Street, Suite 600,
>> Toronto, Ontario M5A 4J5
>> Phone:  +1-416-203-3003 x 238
>> Email:  nkronenfeld@oculusinfo.com
>>
>
>


-- 
Nathan Kronenfeld
Senior Visualization Developer
Oculus Info Inc
2 Berkeley Street, Suite 600,
Toronto, Ontario M5A 4J5
Phone:  +1-416-203-3003 x 238
Email:  nkronenfeld@oculusinfo.com

Mime
View raw message