spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Marcelo Vanzin <van...@cloudera.com.INVALID>
Subject Re: Multiple context in one Driver
Date Thu, 14 Mar 2019 16:18:24 GMT
It doesn't work (except if you're extremely lucky), it will eat your
lunch and will also kick your dog.

And it's not even going to be an option in the next version of Spark.

On Wed, Mar 13, 2019 at 11:38 PM Ido Friedman <ido.friedman@equalum.io> wrote:
>
> Hi,
>
> I am researching the use of multiple sparkcontext in one Driver - spark.driver.allowMultipleContexts
>
> I found various opinions and notes on the subject, most were against it and some said
it is "work in progress"
>
> What is "official" approach on this subject? Can we use this as a significant part of
our spark implementation?
>
> 10x
>
> Ido Friedman
>
> --



-- 
Marcelo

---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org


Mime
View raw message