Mailing-List: contact dev-help@flink.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@flink.apache.org
MIME-Version: 1.0
References: <CAGr9p8Ay-PhTtSDgYfZEaDogmiJMZnkuNtJAJVOeUBNv5YORzw@mail.gmail.com>
 <CANC1h_vPtYpdVybH7v+NckvaUOJB7Qh1T4xx6ZQc_Mt8eq_=ew@mail.gmail.com>
 <CANC1h_sW5LfmoNuohq20aiDjSvQa9aMdzKsdt8pyKR3QwnPq8g@mail.gmail.com>
 <CAMruJR-iRAdNjoS5sbVX22KdYuxt8On1YWxgKH72=CtFZKGwhg@mail.gmail.com>
 <CANC1h_tXyavwoD0tiCphBbGXF6yBtJ_2JpBQH37zbWd++PkMcw@mail.gmail.com>
 <CAMruJR-1QfHzCngk2UeC4f-gixUK+UgTrSWec7cNm_ekWUUS9g@mail.gmail.com>
 <CANC1h_vb__TkaTbh8gxkAFoK14RtHP9W=2+FFhp64FMuA70biQ@mail.gmail.com>
 <CAGr9p8CtaaWbW_12Uh0opiGRQtt_UkTzu=6y-oboUFEjfa9txA@mail.gmail.com>
 <565c0c92-468f-4d95-fe6a-cefe9722d18c@apache.org> <CA+faj9wG8-bsDYdGQT00KdGXTuXEAEoxeggzqx5L11EP8s4wTQ@mail.gmail.com>
 <27a7c055-0756-cb4d-ea6f-0303cbe63135@apache.org> <CA+faj9wOe9seOnZgFBOrN2nyxt10bHfSL6BubMP40_yd0DKdog@mail.gmail.com>
 <CAMruJR-hTyGjMiEyOq_7rvSx1sykAQmCo66iXux7HKMW0vQiFA@mail.gmail.com>
 <CAC27z=PXHVbTu2_fuNv+VEUByv6x4RW1wtg_DQ4-8LTAYp-Fcg@mail.gmail.com>
 <CA+faj9zWSBAwJenAHBnLX-E+Q7dYcUBbTMSvhuy9UD6YpgJ8_Q@mail.gmail.com>
 <E62878A6-EB6B-488E-9687-E81E8F829520@data-artisans.com> <CA+faj9wm-1UVYXXK-qzRZhZ4y-9eiqE6+LP2dOrb50m4MfyhUA@mail.gmail.com>
In-Reply-To: <CA+faj9wm-1UVYXXK-qzRZhZ4y-9eiqE6+LP2dOrb50m4MfyhUA@mail.gmail.com>
From: Renjie Liu <liurenjie2008@gmail.com>
Date: Thu, 11 May 2017 08:45:23 +0000
Message-ID: <CAMruJR_dmpATk6pdGn6Qsy_5GgTdNusuL4d_LNxA4MgfGy9w0g@mail.gmail.com>
Subject: Re: [DISCUSS] Release 1.3.0 RC0 (Non voting, testing release candidate)
To: dev@flink.apache.org
Content-Type: multipart/alternative; boundary=001a11401c38b54d81054f3b9cbf
archived-at: Thu, 11 May 2017 08:45:42 -0000

--001a11401c38b54d81054f3b9cbf
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

@Rohrmann Will FLIP 6 be fully functional in 1.3 release?

On Thu, May 11, 2017 at 4:12 PM Gyula F=C3=B3ra <gyula.fora@gmail.com> wrot=
e:

> Thanks Stefan!
> Gyula
>
> Stefan Richter <s.richter@data-artisans.com> ezt =C3=ADrta (id=C5=91pont:=
 2017. m=C3=A1j.
> 11., Cs, 10:04):
>
> >
> > Hi,
> >
> > Thanks for reporting this. I found a couple of issues yesterday and I a=
m
> > currently working on a bundle of fixes. I will take a look at this
> problem,
> > and if it is already covered.
> >
> > Best,
> > Stefan
> >
> > > Am 11.05.2017 um 09:47 schrieb Gyula F=C3=B3ra <gyula.fora@gmail.com>=
:
> > >
> > > Hi,
> > > I am not sure if this belong to this thread, but while trying to run =
a
> > job
> > > with rocks incremental backend I ran into 2 issues:
> > >
> > > One with savepoints, I can't figure out because I can't make sense of
> the
> > > error or how it happenned:
> > > The error stack trace is here:
> > > https://gist.github.com/gyfora/2f7bb387bbd9f455f9702908cde0b239
> > > This happens on every savepoint attempt and seems to be related to th=
e
> > > kafka source. Interestingly other tasks succeed in writing data to
> hdfs.
> > >
> > > The other one is covered by
> > https://issues.apache.org/jira/browse/FLINK-6531 I
> > > guess. I am not sure if the first one is related though.
> > >
> > > Thank you!
> > > Gyula
> > >
> > > Till Rohrmann <trohrmann@apache.org> ezt =C3=ADrta (id=C5=91pont: 201=
7. m=C3=A1j.
> 11.,
> > Cs,
> > > 9:14):
> > >
> > >> Hi Renjie,
> > >>
> > >> 1.3 already contains some Flip-6 code. However, it is not yet fully
> > >> functional. What you already can do is to run local jobs on the Flip=
-6
> > code
> > >> base by instantiating a MiniCluster and then using the
> > >> Flip6LocalStreamEnvironment.
> > >>
> > >> Cheers,
> > >> Till
> > >>
> > >> On Thu, May 11, 2017 at 6:00 AM, Renjie Liu <liurenjie2008@gmail.com=
>
> > >> wrote:
> > >>
> > >>> Hi, all:
> > >>> Will the FLIP 6 be included in release 1.3?
> > >>>
> > >>> On Wed, May 10, 2017 at 9:48 PM Gyula F=C3=B3ra <gyula.fora@gmail.c=
om>
> > wrote:
> > >>>
> > >>>> Thanks you! :)
> > >>>>
> > >>>> Chesnay Schepler <chesnay@apache.org> ezt =C3=ADrta (id=C5=91pont:=
 2017. m=C3=A1j.
> > >> 10.,
> > >>>> Sze, 15:44):
> > >>>>
> > >>>>> I guess it is related to this one
> > >>>>> https://issues.apache.org/jira/browse/FLINK-6514 ?
> > >>>>>
> > >>>>> On 10.05.2017 15:34, Gyula F=C3=B3ra wrote:
> > >>>>>> Hi,
> > >>>>>>
> > >>>>>> I tried to run an application on 1.3 but I keep getting the
> > >> following
> > >>>>> error:
> > >>>>>> java.lang.NoClassDefFoundError: Could not initialize class
> > >>>>>> org.apache.hadoop.security.UserGroupInformation
> > >>>>>> at
> > >>>>>>
> > >>>>>
> > >>>> org.apache.flink.runtime.security.modules.HadoopModule.
> > >>> install(HadoopModule.java:45)
> > >>>>>> at
> > >>>>>>
> > >>>>>
> > >>>> org.apache.flink.runtime.security.SecurityUtils.
> > >>> install(SecurityUtils.java:78)
> > >>>>>> at org.apache.flink.client.CliFrontend.main(CliFrontend.java:112=
8)
> > >>>>>>
> > >>>>>> Even after adding hadoop-common to the lib manually (which I gue=
ss
> > >>>> should
> > >>>>>> not be necessary).
> > >>>>>>
> > >>>>>> Any idea what might cause this?
> > >>>>>>
> > >>>>>> Thanks,
> > >>>>>> Gyula
> > >>>>>>
> > >>>>>> Chesnay Schepler <chesnay@apache.org> ezt =C3=ADrta (id=C5=91pon=
t: 2017.
> > >> m=C3=A1j.
> > >>>> 9.,
> > >>>>> K,
> > >>>>>> 13:27):
> > >>>>>>
> > >>>>>>> I looked into AppVeyor and managed to create a working setup th=
at
> > >>>>>>> replicates the problems i encounter locally.
> > >>>>>>> https://ci.appveyor.com/project/zentol/flink/build/1.0.12
> > >>>>>>>
> > >>>>>>> The integration should be as simple as placing an appveyor.yml
> > >>>> (similar
> > >>>>>>> to the travis.yml) into the repository and asking INFRA to
> enabled
> > >>> it
> > >>>>>>> for Flink.
> > >>>>>>>
> > >>>>>>> I've opened a JIRA to track this initiative:
> > >>>>>>> https://issues.apache.org/jira/browse/FLINK-6510
> > >>>>>>>
> > >>>>>>> On 09.05.2017 10:17, Robert Metzger wrote:
> > >>>>>>>> Chesnay, I would propose to look into a CI solution for Window=
s.
> > >>> I'll
> > >>>>> try
> > >>>>>>>> out appveyor.com for my Flink fork and report back how well it
> > >>> works
> > >>>>>>> (let
> > >>>>>>>> me know if you want to look into it).
> > >>>>>>>>
> > >>>>>>>> On Tue, May 9, 2017 at 10:05 AM, Stephan Ewen <sewen@apache.or=
g
> >
> > >>>>> wrote:
> > >>>>>>>>
> > >>>>>>>>> @Renjie What functionality are you looking for? Most stuff
> > >> should
> > >>>> work
> > >>>>>>> in
> > >>>>>>>>> the normal master branch.
> > >>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>> On Tue, May 9, 2017 at 10:02 AM, Renjie Liu <
> > >>>> liurenjie2008@gmail.com>
> > >>>>>>>>> wrote:
> > >>>>>>>>>
> > >>>>>>>>>> Stephan:
> > >>>>>>>>>> This means that  we can use FLIP 6 for basic functionality
> now?
> > >>> Any
> > >>>>>>>>>> document for setting up that? Will FLIP 6 be finished in
> > >> release
> > >>>> 1.3?
> > >>>>>>>>>>
> > >>>>>>>>>> On Tue, May 9, 2017 at 3:43 PM Stephan Ewen <sewen@apache.or=
g
> >
> > >>>>> wrote:
> > >>>>>>>>>>
> > >>>>>>>>>>> @Renjie Liu: A good part of the FLIP-6 code is in there, bu=
t
> > >> not
> > >>>>> all.
> > >>>>>>>>>>>
> > >>>>>>>>>>> It does run well on Yarn, Mesos, Docker, etc.
> > >>>>>>>>>>>
> > >>>>>>>>>>> We need to finish the FLIP-6 work mainly for full elasticit=
y.
> > >>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>>> On Tue, May 9, 2017 at 5:24 AM, Renjie Liu <
> > >>>> liurenjie2008@gmail.com
> > >>>>>>
> > >>>>>>>>>>> wrote:
> > >>>>>>>>>>>
> > >>>>>>>>>>>> Hi, does this include the FLIP6?
> > >>>>>>>>>>>>
> > >>>>>>>>>>>> On Tue, May 9, 2017 at 2:29 AM Stephan Ewen <
> > >> sewen@apache.org>
> > >>>>>>> wrote:
> > >>>>>>>>>>>>> Did a quick test: Simply adding the
> > >> "org.apache.maven.plugins.
> > >>>>>>>>>>>>> shade.resource.ApacheNoticeResourceTransformer" helps wit=
h
> > >>>> NOTICE
> > >>>>>>>>>>>>> files,
> > >>>>>>>>>>>>> but does not add the required BSD licence copies.
> > >>>>>>>>>>>>>
> > >>>>>>>>>>>>>
> > >>>>>>>>>>>>> On Mon, May 8, 2017 at 8:25 PM, Stephan Ewen <
> > >>> sewen@apache.org>
> > >>>>>>>>> wrote:
> > >>>>>>>>>>>>>> I did the first pass for the legal check.
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>    - Source LICENSE and NOTICE are okay
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>    - In the shaded JAR files, we are not bundling the
> > >>> license
> > >>>>> and
> > >>>>>>>>>>>>>> notice files of the dependencies we include in the shade=
d
> > >>> jars.
> > >>>>>>>>>>>>>>       =3D> Not a problem for Guava (Apache Licensed)
> > >>>>>>>>>>>>>>       =3D> I think is a problem for ASM (redistribution =
in
> > >>>> binary
> > >>>>>>> form,
> > >>>>>>>>>>>>>> hence needs a notice of the copy)
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>    - The Table API / SQL module needs more entries for
> > >>> Janino
> > >>>> /
> > >>>>>>>>>>>>>> Reflections (both BSD licensed)
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>> So that is definitely a blocker.
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>> On Mon, May 8, 2017 at 12:14 PM, Robert Metzger <
> > >>>>>>> rmetzger@apache.org
> > >>>>>>>>>>>>>> wrote:
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>> Hi Devs,
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>> I've created a first non-voting release candidate for
> > >> Flink
> > >>>>> 1.3.0.
> > >>>>>>>>>>>>>>> Please use this RC to test as much as you can and provi=
de
> > >>>>> feedback
> > >>>>>>>>> to
> > >>>>>>>>>>>>>>> the Flink community. The more we find and fix now, the
> > >>> better
> > >>>>>>> Flink
> > >>>>>>>>> 1.3.0
> > >>>>>>>>>>>>>>> wil be :)
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>> I've CC'ed the user@ mailing list to get more people to
> > >>> test
> > >>>>> it.
> > >>>>>>> DO
> > >>>>>>>>>>>>>>> NOT USE THIS RELEASE CANDIDATE IN PRODUCTION.
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>> I will prepare a google document to synchronize the
> > >> testing
> > >>>>>>> effort a
> > >>>>>>>>>>>>>>> bit more.
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>> Depending on the number of issues we identify, I hope
> that
> > >>> we
> > >>>>> can
> > >>>>>>> do
> > >>>>>>>>>>>>>>> the first VOTEing RC early next week.
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>> ------------------------------
> > >>> ------------------------------
> > >>>>>>>>> ---------
> > >>>>>>>>>>>>>>> The release commit is
> > >>>> f94c002991dcce9f1104f8e61b43efb2f8247cb4,
> > >>>>>>>>>>>>>>> located here:
> > >> http://git-wip-us.apache.org/repos/asf/flink/
> > >>>>>>>>>>>>>>> commit/f94c0029
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>> The artifacts are located here: http://people.apache.
> > >>>>>>>>>>>>>>> org/~rmetzger/flink-1.3.0-rc0/
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>> The maven staging repository is here: https://repositor=
y
> .
> > >>>>>>>>>>>>>>> apache.org/content/repositories/orgapacheflink-1118
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>> ------------------------------
> > >>> ------------------------------
> > >>>>>>>>> ---------
> > >>>>>>>>>>>>>>> Happy testing!
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>> Regards,
> > >>>>>>>>>>>>>>> Robert
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>> --
> > >>>>>>>>>>>> Liu, Renjie
> > >>>>>>>>>>>> Software Engineer, MVAD
> > >>>>>>>>>>>>
> > >>>>>>>>>>> --
> > >>>>>>>>>> Liu, Renjie
> > >>>>>>>>>> Software Engineer, MVAD
> > >>>>>>>>>>
> > >>>>>>>
> > >>>>>
> > >>>>>
> > >>>>
> > >>> --
> > >>> Liu, Renjie
> > >>> Software Engineer, MVAD
> > >>>
> > >>
> >
> >
>
--=20
Liu, Renjie
Software Engineer, MVAD

--001a11401c38b54d81054f3b9cbf--