spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ido Friedman <ido.fried...@equalum.io>
Subject Re: Multiple context in one Driver
Date Sun, 17 Mar 2019 11:35:21 GMT
You saved me lots of time.

Thanks.

Ido

On Thu, Mar 14, 2019 at 6:18 PM Marcelo Vanzin <vanzin@cloudera.com> wrote:

> It doesn't work (except if you're extremely lucky), it will eat your
> lunch and will also kick your dog.
>
> And it's not even going to be an option in the next version of Spark.
>
> On Wed, Mar 13, 2019 at 11:38 PM Ido Friedman <ido.friedman@equalum.io>
> wrote:
> >
> > Hi,
> >
> > I am researching the use of multiple sparkcontext in one Driver -
> spark.driver.allowMultipleContexts
> >
> > I found various opinions and notes on the subject, most were against it
> and some said it is "work in progress"
> >
> > What is "official" approach on this subject? Can we use this as a
> significant part of our spark implementation?
> >
> > 10x
> >
> > Ido Friedman
> >
> > --
>
>
>
> --
> Marcelo
>

Mime
View raw message