systemml-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Deron Eriksson <deroneriks...@gmail.com>
Subject Re: Time To Merge Spark 2.0 Support PR
Date Fri, 06 Jan 2017 20:21:43 GMT
I would prefer to move forward with Spark 2 now.

Deron



On Fri, Jan 6, 2017 at 12:15 PM, Mike Dusenberry <dusenberrymw@gmail.com>
wrote:

> I vote that we scratch that release, and move forward with adding Spark 2.x
> support now, and then release on February 1st as discussed on another
> thread this week.  Otherwise, our PR board will continue to be backed up
> without real benefit to the user.
>
> - Mike
>
>
> --
>
> Michael W. Dusenberry
> GitHub: github.com/dusenberrymw
> LinkedIn: linkedin.com/in/mikedusenberry
>
> On Fri, Jan 6, 2017 at 12:03 PM, Acs S <acs_s@yahoo.com.invalid> wrote:
>
> > We are trying to get SystemML 0.12 release out, which slowed down due to
> > holiday period in last 2+ weeksFinal verification pending from Glen
> > (Niketan, Berthed) related to run wrappers related code with 80GB data.
> > Once this get verified we should be in position to release 0.12 and then
> > can plan to get PR related to Spark 2.0 merged.
> > -Arvind
> >
> >       From: Mike Dusenberry <dusenberrymw@gmail.com>
> >  To: dev <dev@systemml.incubator.apache.org>
> >  Sent: Friday, January 6, 2017 11:54 AM
> >  Subject: Time To Merge Spark 2.0 Support PR
> >
> > Hi to the SystemML community!
> >
> > As you may know, SystemML currently only supports Spark 1.6, and does not
> > yet support Spark 2.x.  However, there is an open PR (
> > https://github.com/apache/incubator-systemml/pull/202) that replaces
> Spark
> > 1.6 support with Spark 2.x support.
> >
> > Spark 2.0.0 was released on July 26, 2016 (
> > https://spark.apache.org/news/spark-2-0-0-released.html), and 2.1.0 is
> now
> > available (https://spark.apache.org/news/spark-2-1-0-released.html).
> >
> > I think it is time to merge the above PR into the master branch of the
> > project in order to move SystemML onto Spark 2.x.
> >
> > Thoughts?  If no objections, I'd like to merge next week.
> >
> >
> > Cheers!
> >
> > - Mike
> >
> > --
> >
> > Michael W. Dusenberry
> > GitHub: github.com/dusenberrymw
> > LinkedIn: linkedin.com/in/mikedusenberry
> >
> >
> >
> >
>



-- 
Deron Eriksson
Spark Technology Center
http://www.spark.tc/

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message