Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id F1FFC200BF4 for ; Fri, 6 Jan 2017 21:26:25 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id F0803160B39; Fri, 6 Jan 2017 20:26:25 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id EE9E8160B37 for ; Fri, 6 Jan 2017 21:26:24 +0100 (CET) Received: (qmail 92554 invoked by uid 500); 6 Jan 2017 20:26:24 -0000 Mailing-List: contact dev-help@systemml.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@systemml.incubator.apache.org Delivered-To: mailing list dev@systemml.incubator.apache.org Received: (qmail 92543 invoked by uid 99); 6 Jan 2017 20:26:23 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 06 Jan 2017 20:26:23 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 795A6C14B9 for ; Fri, 6 Jan 2017 20:26:23 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.299 X-Spam-Level: * X-Spam-Status: No, score=1.299 tagged_above=-999 required=6.31 tests=[HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001, TVD_FW_GRAPHIC_NAME_MID=0.001] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id 24Ur2Rf3FBlR for ; Fri, 6 Jan 2017 20:26:22 +0000 (UTC) Received: from mx0a-001b2d01.pphosted.com (mx0b-001b2d01.pphosted.com [148.163.158.5]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id AFD6A5F23D for ; Fri, 6 Jan 2017 20:26:21 +0000 (UTC) Received: from pps.filterd (m0098416.ppops.net [127.0.0.1]) by mx0b-001b2d01.pphosted.com (8.16.0.17/8.16.0.17) with SMTP id v06KOUYI070589 for ; Fri, 6 Jan 2017 15:26:20 -0500 Received: from e36.co.us.ibm.com (e36.co.us.ibm.com [32.97.110.154]) by mx0b-001b2d01.pphosted.com with ESMTP id 27tb588c5n-1 (version=TLSv1.2 cipher=AES256-SHA bits=256 verify=NOT) for ; Fri, 06 Jan 2017 15:26:20 -0500 Received: from localhost by e36.co.us.ibm.com with IBM ESMTP SMTP Gateway: Authorized Use Only! Violators will be prosecuted for from ; Fri, 6 Jan 2017 13:26:19 -0700 Received: from d03dlp01.boulder.ibm.com (9.17.202.177) by e36.co.us.ibm.com (192.168.1.136) with IBM ESMTP SMTP Gateway: Authorized Use Only! Violators will be prosecuted; Fri, 6 Jan 2017 13:26:17 -0700 X-IBM-Helo: d03dlp01.boulder.ibm.com X-IBM-MailFrom: npansar@us.ibm.com X-IBM-RcptTo: dev@systemml.incubator.apache.org Received: from b03cxnp08026.gho.boulder.ibm.com (b03cxnp08026.gho.boulder.ibm.com [9.17.130.18]) by d03dlp01.boulder.ibm.com (Postfix) with ESMTP id CBF111FF001F for ; Fri, 6 Jan 2017 13:25:55 -0700 (MST) Received: from b03ledav006.gho.boulder.ibm.com (b03ledav006.gho.boulder.ibm.com [9.17.130.237]) by b03cxnp08026.gho.boulder.ibm.com (8.14.9/8.14.9/NCO v10.0) with ESMTP id v06KQGE111469110 for ; Fri, 6 Jan 2017 13:26:16 -0700 Received: from b03ledav006.gho.boulder.ibm.com (unknown [127.0.0.1]) by IMSVA (Postfix) with ESMTP id C7C22C603E for ; Fri, 6 Jan 2017 13:26:16 -0700 (MST) Received: from e39.co.us.ibm.com (unknown [9.17.249.49]) by b03ledav006.gho.boulder.ibm.com (Postfix) with ESMTPS id BBD6AC603C for ; Fri, 6 Jan 2017 13:26:16 -0700 (MST) Received: from localhost by e39.co.us.ibm.com with IBM ESMTP SMTP Gateway: Authorized Use Only! Violators will be prosecuted for from ; Fri, 6 Jan 2017 13:26:16 -0700 Received: from smtp.notes.na.collabserv.com (192.155.248.72) by e39.co.us.ibm.com (192.168.2.139) with IBM ESMTP SMTP Gateway: Authorized Use Only! Violators will be prosecuted; (version=TLSv1/SSLv3 cipher=AES128-GCM-SHA256 bits=128/128) Fri, 6 Jan 2017 13:26:15 -0700 Received: from localhost by smtp.notes.na.collabserv.com with smtp.notes.na.collabserv.com ESMTP for from ; Fri, 6 Jan 2017 20:26:14 -0000 Received: from us1a3-smtp04.a3.dal06.isc4sb.com (10.106.154.237) by smtp.notes.na.collabserv.com (10.106.227.158) with smtp.notes.na.collabserv.com ESMTP; Fri, 6 Jan 2017 20:26:13 -0000 Received: from us1a3-mail56.a3.dal09.isc4sb.com ([10.142.3.44]) by us1a3-smtp04.a3.dal06.isc4sb.com with ESMTP id 2017010620261257-260005 ; Fri, 6 Jan 2017 20:26:12 +0000 MIME-Version: 1.0 In-Reply-To: Subject: Re: Time To Merge Spark 2.0 Support PR To: dev@systemml.incubator.apache.org From: "Niketan Pansare" Date: Fri, 6 Jan 2017 12:26:24 -0800 References: <2059965016.1311284.1483733015531@mail.yahoo.com> X-KeepSent: 9EF997A3:59F3A7DE-002580A0:006FFE06; type=4; name=$KeepSent X-Mailer: IBM Notes Release 9.0.1FP5 SHF190 February 24, 2016 X-LLNOutbound: False X-Disclaimed: 28343 X-TNEFEvaluated: 1 Content-type: multipart/related; Boundary="0__=8FBB0A33DFFC78968f9e8a93df938690918c8FBB0A33DFFC7896" x-cbid: 17010620-0020-0000-0000-00000AABFC49 X-IBM-ISS-SpamDetectors: Score=0.387138; BY=0.134001; FL=0; FP=0; FZ=0; HX=0; KW=0; PH=0; SC=0.387138; ST=0; TS=0; UL=0; ISC= X-IBM-ISS-DetailInfo: BY=3.00006385; HX=3.00000240; KW=3.00000007; PH=3.00000004; SC=3.00000199; SDB=6.00804508; UDB=6.00391505; UTC=2017-01-06 20:26:14 x-cbparentid: 17010620-6060-0000-0000-000003DC9739 X-IBM-AV-DETECTION: SAVI=unused REMOTE=unused XFE=unused X-TM-AS-GCONF: 00 X-Content-Scanned: Fidelis XPS MAILER X-IBM-SpamModules-Scores: X-IBM-SpamModules-Versions: BY=3.00006385; HX=3.00000240; KW=3.00000007; PH=3.00000004; SC=3.00000199; SDB=6.00804508; UDB=6.00391505; IPR=6.00582355; BA=6.00005032; NDR=6.00000001; ZLA=6.00000005; ZF=6.00000009; ZB=6.00000000; ZP=6.00000000; ZH=6.00000000; ZU=6.00000002; MB=3.00013845; XFM=3.00000011; UTC=2017-01-06 20:26:18 X-IBM-AV-DETECTION: SAVI=unused REMOTE=unused XFE=unused Message-Id: X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10432:,, definitions=2017-01-06_14:,, signatures=0 X-Proofpoint-Spam-Details: rule=outbound_notspam policy=outbound score=0 spamscore=0 suspectscore=1 malwarescore=0 phishscore=0 adultscore=0 bulkscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.0.1-1612050000 definitions=main-1701060296 archived-at: Fri, 06 Jan 2017 20:26:26 -0000 --0__=8FBB0A33DFFC78968f9e8a93df938690918c8FBB0A33DFFC7896 Content-type: multipart/alternative; Boundary="1__=8FBB0A33DFFC78968f9e8a93df938690918c8FBB0A33DFFC7896" --1__=8FBB0A33DFFC78968f9e8a93df938690918c8FBB0A33DFFC7896 Content-Transfer-Encoding: quoted-printable Content-type: text/plain; charset=US-ASCII Since many users still use 1.6 and our previous release do not have python artifact, it would be a good idea to do a 0.12 release with Spark 1.6 and python artifact first. Then, we merge the PR for Spark 2.0. Thanks, Niketan Pansare IBM Almaden Research Center E-mail: npansar At us.ibm.com http://researcher.watson.ibm.com/researcher/view.php?person=3Dus-npansar From: Deron Eriksson To: dev@systemml.incubator.apache.org Cc: Acs S Date: 01/06/2017 12:21 PM Subject: Re: Time To Merge Spark 2.0 Support PR I would prefer to move forward with Spark 2 now. Deron On Fri, Jan 6, 2017 at 12:15 PM, Mike Dusenberry wrote: > I vote that we scratch that release, and move forward with adding Spark 2.x > support now, and then release on February 1st as discussed on another > thread this week. Otherwise, our PR board will continue to be backed up > without real benefit to the user. > > - Mike > > > -- > > Michael W. Dusenberry > GitHub: github.com/dusenberrymw > LinkedIn: linkedin.com/in/mikedusenberry > > On Fri, Jan 6, 2017 at 12:03 PM, Acs S wrote: > > > We are trying to get SystemML 0.12 release out, which slowed down due to > > holiday period in last 2+ weeksFinal verification pending from Glen > > (Niketan, Berthed) related to run wrappers related code with 80GB data. > > Once this get verified we should be in position to release 0.12 and then > > can plan to get PR related to Spark 2.0 merged. > > -Arvind > > > > From: Mike Dusenberry > > To: dev > > Sent: Friday, January 6, 2017 11:54 AM > > Subject: Time To Merge Spark 2.0 Support PR > > > > Hi to the SystemML community! > > > > As you may know, SystemML currently only supports Spark 1.6, and does not > > yet support Spark 2.x. However, there is an open PR ( > > https://github.com/apache/incubator-systemml/pull/202) that replaces > Spark > > 1.6 support with Spark 2.x support. > > > > Spark 2.0.0 was released on July 26, 2016 ( > > https://spark.apache.org/news/spark-2-0-0-released.html), and 2.1.0 is > now > > available (https://spark.apache.org/news/spark-2-1-0-released.html). > > > > I think it is time to merge the above PR into the master branch of the > > project in order to move SystemML onto Spark 2.x. > > > > Thoughts? If no objections, I'd like to merge next week. > > > > > > Cheers! > > > > - Mike > > > > -- > > > > Michael W. Dusenberry > > GitHub: github.com/dusenberrymw > > LinkedIn: linkedin.com/in/mikedusenberry > > > > > > > > > -- Deron Eriksson Spark Technology Center http://www.spark.tc/ --1__=8FBB0A33DFFC78968f9e8a93df938690918c8FBB0A33DFFC7896 Content-Transfer-Encoding: quoted-printable Content-type: text/html; charset=US-ASCII Content-Disposition: inline

Since many users still use 1.6 and our previous release do n= ot have python artifact, it would be a good idea to do a 0.12 release with = Spark 1.6 and python artifact first. Then, we merge the PR for Spark 2.0.
Thanks,

Niketan Pansare
IBM Almaden Research Center
E-ma= il: npansar At us.ibm.com
http://researcher.watson.ibm.com/res= earcher/view.php?person=3Dus-npansar

3D"InactiveDeron Eriksson ---01/06/2017 12:21:58 PM---I would prefer to m= ove forward with Spark 2 now. Deron

From: Deron Eriksson <deronerik= sson@gmail.com>
To: = dev@systemml.incubator.apache.org
Cc: Acs S <ac= s=5Fs@yahoo.com>
Date: = 01/06/2017 12:21 PM
Subject: Re: Time To Merge = Spark 2.0 Support PR




I would prefer to move f= orward with Spark 2 now.

Deron



On Fri, Jan 6, 2017 at= 12:15 PM, Mike Dusenberry <dusenberrymw@gmail.com>
wrote:

= > I vote that we scratch that release, and move forward with adding Spar= k 2.x
> support now, and then release on February 1st as discussed on= another
> thread this week.  Otherwise, our PR board will conti= nue to be backed up
> without real benefit to the user.
>
&g= t; - Mike
>
>
> --
>
> Michael W. Dusenberry<= br>> GitHub: github.com/dusenberrymw
> LinkedIn: linkedin.com/in/m= ikedusenberry
>
> On Fri, Jan 6, 2017 at 12:03 PM, Acs S <ac= s=5Fs@yahoo.com.invalid> wrote:
>
> > We are trying to ge= t SystemML 0.12 release out, which slowed down due to
> > holiday = period in last 2+ weeksFinal verification pending from Glen
> > (N= iketan, Berthed) related to run wrappers related code with 80GB data.
&g= t; > Once this get verified we should be in position to release 0.12 and= then
> > can plan to get PR related to Spark 2.0 merged.
> = > -Arvind
> >
> >       From: Mike Duse= nberry <dusenberrymw@gmail.com>
> >  To: dev <dev@sy= stemml.incubator.apache.org>
> >  Sent: Friday, January 6,= 2017 11:54 AM
> >  Subject: Time To Merge Spark 2.0 Support = PR
> >
> > Hi to the SystemML community!
> >
= > > As you may know, SystemML currently only supports Spark 1.6, and = does not
> > yet support Spark 2.x.  However, there is an ope= n PR (
> > https://github.com/apache/incubator-systemml/pull/202) that replaces
> Spark
> > 1.6 support with Spar= k 2.x support.
> >
> > Spark 2.0.0 was released on July 2= 6, 2016 (
> > https://spark.apache.org/news/spark-2-0-0-released= .html), and 2.1.0 is
> now
> > available (= htt= ps://spark.apache.org/news/spark-2-1-0-released.html).
>= >
> > I think it is time to merge the above PR into the master= branch of the
> > project in order to move SystemML onto Spark 2.= x.
> >
> > Thoughts?  If no objections, I'd like to = merge next week.
> >
> >
> > Cheers!
> >= ;
> > - Mike
> >
> > --
> >
> >= ; Michael W. Dusenberry
> > GitHub: github.com/dusenberrymw
>= ; > LinkedIn: linkedin.com/in/mikedusenberry
> >
> >> >
> >
>



--
Deron Eriksson
Sp= ark Technology Center
http://w= ww.spark.tc/



--1__=8FBB0A33DFFC78968f9e8a93df938690918c8FBB0A33DFFC7896-- --0__=8FBB0A33DFFC78968f9e8a93df938690918c8FBB0A33DFFC7896--