Return-Path: X-Original-To: apmail-flink-dev-archive@www.apache.org Delivered-To: apmail-flink-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 7F77E171D6 for ; Wed, 11 Mar 2015 18:15:48 +0000 (UTC) Received: (qmail 73324 invoked by uid 500); 11 Mar 2015 18:15:48 -0000 Delivered-To: apmail-flink-dev-archive@flink.apache.org Received: (qmail 73263 invoked by uid 500); 11 Mar 2015 18:15:48 -0000 Mailing-List: contact dev-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@flink.apache.org Delivered-To: mailing list dev@flink.apache.org Received: (qmail 73252 invoked by uid 99); 11 Mar 2015 18:15:48 -0000 Received: from mail-relay.apache.org (HELO mail-relay.apache.org) (140.211.11.15) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 11 Mar 2015 18:15:48 +0000 Received: from mail-la0-f41.google.com (mail-la0-f41.google.com [209.85.215.41]) by mail-relay.apache.org (ASF Mail Server at mail-relay.apache.org) with ESMTPSA id A16B91A02C0 for ; Wed, 11 Mar 2015 18:15:47 +0000 (UTC) Received: by labgm9 with SMTP id gm9so10632761lab.13 for ; Wed, 11 Mar 2015 11:15:46 -0700 (PDT) X-Received: by 10.112.145.230 with SMTP id sx6mr8361091lbb.70.1426097746021; Wed, 11 Mar 2015 11:15:46 -0700 (PDT) MIME-Version: 1.0 Received: by 10.152.180.198 with HTTP; Wed, 11 Mar 2015 11:15:24 -0700 (PDT) In-Reply-To: References: <722DE97D-64E0-463A-8FDA-CFEA71947D8A@icloud.com> From: Robert Metzger Date: Wed, 11 Mar 2015 19:15:24 +0100 Message-ID: Subject: Re: [DISCUSS] Offer Flink with Scala 2.11 To: dev@flink.apache.org Content-Type: multipart/alternative; boundary=047d7b3a7d9291145d05110741e9 --047d7b3a7d9291145d05110741e9 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Thank you for opening the pull request. It looks great so far. There came up one question while discussing Alex changes in the PR: To make this change really usable for our users, we need to provide our users with different poms for each artifact, containing either Scala 2.10 or 2.11. Its basically the same thing we did for Hadoop's dependencies. We would then end up with the versions: 0.9.0 and 0.9.0-hadoop1 and artifacts like "flink-core" and "flink-core_2.11". So each module will generate 4 artifacts to maven central. Another option would be to keep everything as it is right now, then users would need to set the properties correctly when building their flink projects. On Wed, Mar 11, 2015 at 12:41 AM, Alexander Alexandrov < alexander.s.alexandrov@gmail.com> wrote: > The PR is here: https://github.com/apache/flink/pull/477 > > Cheers! > > 2015-03-10 18:07 GMT+01:00 Alexander Alexandrov < > alexander.s.alexandrov@gmail.com>: > > > Yes, will do. > > > > 2015-03-10 16:39 GMT+01:00 Robert Metzger : > > > >> Very nice work. > >> The changes are probably somewhat easy to merge. Except for the versio= n > >> properties in the parent pom, there should not be a bigger issue. > >> > >> Can you also add additional build profiles to travis for scala 2.11 ? > >> > >> On Tue, Mar 10, 2015 at 2:50 PM, Alexander Alexandrov < > >> alexander.s.alexandrov@gmail.com> wrote: > >> > >> > We have is almost ready here: > >> > > >> > https://github.com/stratosphere/flink/commits/scala_2.11_rebased > >> > > >> > I wanted to open a PR today > >> > > >> > 2015-03-10 11:28 GMT+01:00 Robert Metzger : > >> > > >> > > Hey Alex, > >> > > > >> > > I don't know the exact status of the Scala 2.11 integration. But I > >> wanted > >> > > to point you to https://github.com/apache/flink/pull/454, which is > >> > > changing > >> > > a huge portion of our maven build infrastructure. > >> > > If you haven't started yet, it might make sense to base your > >> integration > >> > > onto that pull request. > >> > > > >> > > Otherwise, let me know if you have troubles rebasing your changes. > >> > > > >> > > On Mon, Mar 2, 2015 at 9:13 PM, Chiwan Park > >> > wrote: > >> > > > >> > > > +1 for Scala 2.11 > >> > > > > >> > > > Regards. > >> > > > Chiwan Park (Sent with iPhone) > >> > > > > >> > > > > >> > > > > On Mar 3, 2015, at 2:43 AM, Robert Metzger > > >> > > wrote: > >> > > > > > >> > > > > I'm +1 if this doesn't affect existing Scala 2.10 users. > >> > > > > > >> > > > > I would also suggest to add a scala 2.11 build to travis as we= ll > >> to > >> > > > ensure > >> > > > > everything is working with the different Hadoop/JVM versions. > >> > > > > It shouldn't be a big deal to offer scala_version x > hadoop_version > >> > > builds > >> > > > > for newer releases. > >> > > > > You only need to add more builds here: > >> > > > > > >> > > > > >> > > > >> > > >> > https://github.com/apache/flink/blob/master/tools/create_release_files.sh= #L131 > >> > > > > > >> > > > > > >> > > > > > >> > > > > On Mon, Mar 2, 2015 at 6:17 PM, Till Rohrmann < > >> trohrmann@apache.org> > >> > > > wrote: > >> > > > > > >> > > > >> +1 for Scala 2.11 > >> > > > >> > >> > > > >> On Mon, Mar 2, 2015 at 5:02 PM, Alexander Alexandrov < > >> > > > >> alexander.s.alexandrov@gmail.com> wrote: > >> > > > >> > >> > > > >>> Spark currently only provides pre-builds for 2.10 and requir= es > >> > custom > >> > > > >> build > >> > > > >>> for 2.11. > >> > > > >>> > >> > > > >>> Not sure whether this is the best idea, but I can see the > >> benefits > >> > > > from a > >> > > > >>> project management point of view... > >> > > > >>> > >> > > > >>> Would you prefer to have a {scala_version} =C3=97 {hadoop_ve= rsion} > >> > > > integrated > >> > > > >> on > >> > > > >>> the website? > >> > > > >>> > >> > > > >>> 2015-03-02 16:57 GMT+01:00 Aljoscha Krettek < > >> aljoscha@apache.org>: > >> > > > >>> > >> > > > >>>> +1 I also like it. We just have to figure out how we can > >> publish > >> > two > >> > > > >>>> sets of release artifacts. > >> > > > >>>> > >> > > > >>>> On Mon, Mar 2, 2015 at 4:48 PM, Stephan Ewen < > sewen@apache.org > >> > > >> > > > wrote: > >> > > > >>>>> Big +1 from my side! > >> > > > >>>>> > >> > > > >>>>> Does it have to be a Maven profile, or does a maven proper= ty > >> > work? > >> > > > >>>> (Profile > >> > > > >>>>> may be needed for quasiquotes dependency?) > >> > > > >>>>> > >> > > > >>>>> On Mon, Mar 2, 2015 at 4:36 PM, Alexander Alexandrov < > >> > > > >>>>> alexander.s.alexandrov@gmail.com> wrote: > >> > > > >>>>> > >> > > > >>>>>> Hi there, > >> > > > >>>>>> > >> > > > >>>>>> since I'm relying on Scala 2.11.4 on a project I've been > >> working > >> > > > >> on, I > >> > > > >>>>>> created a branch which updates the Scala version used by > >> Flink > >> > > from > >> > > > >>>> 2.10.4 > >> > > > >>>>>> to 2.11.4: > >> > > > >>>>>> > >> > > > >>>>>> https://github.com/stratosphere/flink/commits/scala_2.11 > >> > > > >>>>>> > >> > > > >>>>>> Everything seems to work fine and the PR contains minor > >> changes > >> > > > >>>> compared to > >> > > > >>>>>> Spark: > >> > > > >>>>>> > >> > > > >>>>>> https://issues.apache.org/jira/browse/SPARK-4466 > >> > > > >>>>>> > >> > > > >>>>>> If you're interested, I can rewrite this as a Maven Profi= le > >> and > >> > > > >> open a > >> > > > >>>> PR > >> > > > >>>>>> so people can build Flink with 2.11 support. > >> > > > >>>>>> > >> > > > >>>>>> I suggest to do this sooner rather than later in order to > >> > > > >>>>>> > >> > > > >>>>>> * the number of code changes enforced by migration small > and > >> > > > >>> tractable; > >> > > > >>>>>> * discourage the use of deprecated or 2.11-incompatible > >> source > >> > > code > >> > > > >> in > >> > > > >>>>>> future commits; > >> > > > >>>>>> > >> > > > >>>>>> Regards, > >> > > > >>>>>> A. > >> > > > >>>>>> > >> > > > >>>> > >> > > > >>> > >> > > > >> > >> > > > > >> > > > > >> > > > >> > > >> > > > > > --047d7b3a7d9291145d05110741e9--