spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Yu <yuzhih...@gmail.com>
Subject Re: Cache in Spark
Date Fri, 09 Oct 2015 20:31:38 GMT
For RDD, I found this method:
  def getStorageLevel: StorageLevel = storageLevel

FYI

On Fri, Oct 9, 2015 at 2:46 AM, vinod kumar <vinodsachin006@gmail.com>
wrote:

> Thanks Natu,
>
> If so,Can you please share me the Spark SQL query to check whether the
> given table is cached or not? if you know
>
> Thanks,
> Vinod
>
> On Fri, Oct 9, 2015 at 2:26 PM, Natu Lauchande <nlauchande@gmail.com>
> wrote:
>
>>
>> I don't think so.
>>
>> Spark is not keeping the results in memory unless you tell it too.
>>
>> You have to explicitly call the cache method in your RDD:
>> linesWithSpark.cache()
>>
>> Thanks,
>> Natu
>>
>>
>>
>>
>> On Fri, Oct 9, 2015 at 10:47 AM, vinod kumar <vinodsachin006@gmail.com>
>> wrote:
>>
>>> Hi Guys,
>>>
>>> May I know whether cache is enabled in spark by default?
>>>
>>> Thanks,
>>> Vinod
>>>
>>
>>
>

Mime
View raw message