Mailing-List: contact dev-help@flink.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@flink.apache.org
MIME-Version: 1.0
In-Reply-To: <564F1E50.5020506@apache.org>
References: 
 <CAGr9p8CsdZm1FeuaOsV3S0YXouO1=j77m0dRVZ7=wTY6i_gX6Q@mail.gmail.com>
 <CAOtpBji_2oYFsOfyp07Bz+LpTanZSbPYBbsX7sjOEpJNatno2A@mail.gmail.com>
 <CAC27z=Mjw0ERzi2ypB7EdCvaj=6Tm4iupVc5yPc_wdP+OQTN1g@mail.gmail.com>
 <CAOtpBjg0dy-p8G5fY5K+g6HUCKi4V+8S-NuaC6hEJkLab_PC-A@mail.gmail.com>
 <CAGr9p8BOsGPOnSbj4JSdqX0b=CCDNyDdH--k6ZzxL05xGjgwNg@mail.gmail.com>
 <CANC1h_tsJV0b19qN=6HA2GhWNPu4SLHdyVSk8DzAVBTWdQ3PjQ@mail.gmail.com>
 <CAGr9p8C-4REx=rrTunGRZ-yMR-z3canV-nG9ySLN85StPpf6rA@mail.gmail.com>
 <CAC27z=M9magXrUWjBuKeb2q_NJX7+fRMbrZBFVmtvnVEUGMo5Q@mail.gmail.com>
 <CA+faj9w1Mtdht4+u4vf=tZagV-k6767WzQ=6_r-TYnBDQ9ZSRQ@mail.gmail.com>
 <CAKiyyaGxWzkx5k16QiUNRfepRFqDmF7=1RcfazjG-57FsxYMag@mail.gmail.com>
 <CA+faj9x=QPSx8iHKt5OeFDKWSYeUeGkNMVax1FWGN66VBBT5xQ@mail.gmail.com>
 <CAC27z=Mxe-qUiTU_0wNBCWkHGwF2mKwLToTSBgW3va5a1xeyBg@mail.gmail.com>
 <564F15A9.2060003@apache.org>
 <CAC27z=O6x2Ld-8EHybAPEYnsgEDvBogL5Xf4UPj7Xa=THiQJow@mail.gmail.com>
 <564F1E50.5020506@apache.org>
From: Robert Metzger <rmetzger@apache.org>
Date: Sun, 22 Nov 2015 12:30:11 +0100
Message-ID: 
 <CAGr9p8D=D5ixOBR=1hhjQ-_BXq4nVLGTPNiU-W_QKVGau_KmEg@mail.gmail.com>
Subject: Re: [DISCUSS] Release Flink 0.10.1 soon
To: "dev@flink.apache.org" <dev@flink.apache.org>
Content-Type: multipart/alternative; boundary=001a11c26464ab9ba205251f6f56

--001a11c26464ab9ba205251f6f56
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

It seems that we have merged all critical fixes into the release-0.10
branch.
Since nobody else stepped up as a release manager, I'll do it again.
It has been a while.... Lets see how the scripts have evolved ;)

On Fri, Nov 20, 2015 at 2:21 PM, Matthias J. Sax <mjsax@apache.org> wrote:

> Nice.
>
> I just would need to get some feedback about it -- I had to change
> something in a "hacky way"... Maybe there is a better solution for it...
>
> https://github.com/apache/flink/pull/1387
>
> I there is no better idea about solving the naming issue, I would merge
> it into master (there is no 0.10.1 branch yet, right?)
>
> -Matthias
>
> On 11/20/2015 01:54 PM, Till Rohrmann wrote:
> > If it' not API breaking, then it can be included imo.
> >
> > On Fri, Nov 20, 2015 at 1:44 PM, Matthias J. Sax <mjsax@apache.org>
> wrote:
> >
> >> If we find more bugs later on, we could have a 0.10.2, too.
> >>
> >> +1 for quick bug fix release.
> >>
> >> Question: should bug fix releases contain fixes for core components
> >> only? I would have a fix for a bug in Storm compatibility -- not sure =
if
> >> it should be included or not
> >>
> >> -Matthias
> >>
> >> On 11/20/2015 12:35 PM, Till Rohrmann wrote:
> >>> The optimizer bug (https://issues.apache.org/jira/browse/FLINK-3052)
> >> should
> >>> be fixed with https://github.com/apache/flink/pull/1388.
> >>>
> >>> On Fri, Nov 20, 2015 at 11:37 AM, Gyula F=C3=B3ra <gyula.fora@gmail.c=
om>
> >> wrote:
> >>>
> >>>> Thanks guys,
> >>>>
> >>>> I understand your point and you are probably right, if this is a
> >>>> lightweight process than the earlier the better :)
> >>>>
> >>>> Gyula
> >>>> On Fri, Nov 20, 2015 at 11:34 AM Ufuk Celebi <uce@apache.org> wrote:
> >>>>
> >>>>> Hey Gyula,
> >>>>>
> >>>>> I understand your point, but we already have some important fixes f=
or
> >>>>> 0.10.1. It's fair to assume that we will find more issues in the
> >> future,
> >>>>> but the bugfix releases have way less overhead than the major
> >> releases. I
> >>>>> would still keep the ASAP schedule and would not wait longer (excep=
t
> >> for
> >>>>> the case that the we find an important issue that we want fixed). W=
e
> >> can
> >>>>> always do a new bug fix release.
> >>>>>
> >>>>> =E2=80=93 Ufuk
> >>>>>
> >>>>> On Fri, Nov 20, 2015 at 11:25 AM, Gyula F=C3=B3ra <gyula.fora@gmail=
.com>
> >>>> wrote:
> >>>>>
> >>>>>> Hi all,
> >>>>>>
> >>>>>> Wouldnt you think that it would make sense to wait a week or so to
> >> find
> >>>>> all
> >>>>>> the hot issues with the current release?
> >>>>>>
> >>>>>> To me it feels a little bit like rushing this out and we will have
> >>>> almost
> >>>>>> the same situation afterwards.
> >>>>>>
> >>>>>> I might be wrong but I think people should get a chance to try thi=
s
> >>>> out.
> >>>>>>
> >>>>>> In any case I would +1 for the quick release if everyone else thin=
ks
> >>>>> thats
> >>>>>> the way, these are just my thoughts.
> >>>>>>
> >>>>>> Gyula
> >>>>>> On Fri, Nov 20, 2015 at 11:13 AM Till Rohrmann <
> trohrmann@apache.org>
> >>>>>> wrote:
> >>>>>>
> >>>>>>> Actually, I still have another bug related to the optimizer which=
 I
> >>>>> would
> >>>>>>> like to include if possible. The problem is that the optimizer is
> not
> >>>>>> able
> >>>>>>> to push properties properly out of a bulk iteration which in some
> >>>> cases
> >>>>>> can
> >>>>>>> lead to rejected Flink jobs.
> >>>>>>>
> >>>>>>> On Fri, Nov 20, 2015 at 11:10 AM, Robert Metzger <
> >>>> rmetzger@apache.org>
> >>>>>>> wrote:
> >>>>>>>
> >>>>>>>> Great, thank you!
> >>>>>>>>
> >>>>>>>> Let me know if there is any issue, I'll address it asap. The PR =
is
> >>>>> not
> >>>>>>>> building anymore because you've pushed an update to the Kafka
> >>>>>>>> documentation. I can rebase and merge the PR once you give me
> green
> >>>>>> light
> >>>>>>>> ;)
> >>>>>>>>
> >>>>>>>> Till has merged FLINK-3021, so we might be able to have a first =
RC
> >>>>>> today.
> >>>>>>>>
> >>>>>>>>
> >>>>>>>> On Fri, Nov 20, 2015 at 11:05 AM, Stephan Ewen <sewen@apache.org=
>
> >>>>>> wrote:
> >>>>>>>>
> >>>>>>>>> Let me look at FLINK-2974 (open PR) to see if it can be merged.=
..
> >>>>>>>>>
> >>>>>>>>> On Thu, Nov 19, 2015 at 10:09 PM, Robert Metzger <
> >>>>>> rmetzger@apache.org>
> >>>>>>>>> wrote:
> >>>>>>>>>
> >>>>>>>>>> Looks like we didn't manage to merge everything today.
> >>>>>>>>>>
> >>>>>>>>>> (pending PRs)
> >>>>>>>>>> - FLINK-3021 Fix class loading issue for streaming sources
> >>>>>>>>>> - FLINK-2974 Add periodic offset committer for Kafka
> >>>>>>>>>>
> >>>>>>>>>> (merged)
> >>>>>>>>>> - FLINK-2977 Using reflection to load HBase Kerberos tokens
> >>>>>>>>>> - FLINK-3024 Fix TimestampExtractor.getCurrentWatermark()
> >>>>> Behaviour
> >>>>>>>>>> - FLINK-2967 Increase timeout for LOCAL_HOST address detection
> >>>>>>> stratey
> >>>>>>>>>> - FLINK-3025 [kafka consumer] Bump transitive ZkClient
> >>>> dependency
> >>>>>>>>>> (merged since my first email)
> >>>>>>>>>> - FLINK-2989 job cancel button doesn't work on YARN
> >>>>>>>>>> - FLINK-3032: Flink does not start on Hadoop 2.7.1 (HDP), due
> >>>> to
> >>>>>>> class
> >>>>>>>>>> conflict
> >>>>>>>>>> - FLINK-3011, 3019, 3028 Cancel jobs in RESTARTING state
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>> Is anybody volunteering to be a release manager?
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>> On Thu, Nov 19, 2015 at 10:16 AM, Suneel Marthi <
> >>>>>> smarthi@apache.org>
> >>>>>>>>>> wrote:
> >>>>>>>>>>
> >>>>>>>>>>> Flink-3017, Flink-3022, and some hotfixes u had put in over
> >>>> the
> >>>>>>> past
> >>>>>>>>> few
> >>>>>>>>>>> days.
> >>>>>>>>>>>
> >>>>>>>>>>> Flink-3041 and Flink-3043 are pending PRs at the moment.
> >>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>>> On Thu, Nov 19, 2015 at 4:10 AM, Till Rohrmann <
> >>>>>>>>> till.rohrmann@gmail.com>
> >>>>>>>>>>> wrote:
> >>>>>>>>>>>
> >>>>>>>>>>>> If they cover things which are also wrongly documented in
> >>>>> 0.10,
> >>>>>>>> then
> >>>>>>>>>> they
> >>>>>>>>>>>> should be merged to 0.10-release as well.
> >>>>>>>>>>>>
> >>>>>>>>>>>> On Thu, Nov 19, 2015 at 10:01 AM, Suneel Marthi <
> >>>>>>>>>> suneel.marthi@gmail.com
> >>>>>>>>>>>>
> >>>>>>>>>>>> wrote:
> >>>>>>>>>>>>
> >>>>>>>>>>>>> @Till Should the recent updates to docs/apis/
> >>>>>>> streaming-guide.md
> >>>>>>>> be
> >>>>>>>>>>> also
> >>>>>>>>>>>>> merged to 'release 0.10'? There are other related PRs
> >>>>>> pending.
> >>>>>>>>>>>>>
> >>>>>>>>>>>>> On Thu, Nov 19, 2015 at 3:42 AM, Till Rohrmann <
> >>>>>>>>> trohrmann@apache.org
> >>>>>>>>>>>
> >>>>>>>>>>>>> wrote:
> >>>>>>>>>>>>>
> >>>>>>>>>>>>>> Yes forgot about merging them to release-0.10. Will do
> >>>> it
> >>>>>>> right
> >>>>>>>>>> away.
> >>>>>>>>>>>>>> On Nov 19, 2015 9:40 AM, "Robert Metzger" <
> >>>>>>> rmetzger@apache.org
> >>>>>>>>>
> >>>>>>>>>>> wrote:
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> @Suneel, I think
> >>>>>>>>>> https://issues.apache.org/jira/browse/FLINK-2949
> >>>>>>>>>>>> is a
> >>>>>>>>>>>>>> new
> >>>>>>>>>>>>>>> feature. The 0.10.1 release is intended as a bugfix
> >>>>>> release
> >>>>>>>>> only.
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> FLINK-3013 and FLINK-3036 have been merged to master
> >>>>>> only.
> >>>>>>>> Are
> >>>>>>>>>>> there
> >>>>>>>>>>>>>> plans
> >>>>>>>>>>>>>>> to merge it to "release-0.10" as well?
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> The list of issues now looks as follows:
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> (pending PRs)
> >>>>>>>>>>>>>>> - FLINK-3032: Flink does not start on Hadoop 2.7.1
> >>>>> (HDP),
> >>>>>>> due
> >>>>>>>>> to
> >>>>>>>>>>>> class
> >>>>>>>>>>>>>>> conflict
> >>>>>>>>>>>>>>> - FLINK-3011, 3019, 3028 Cancel jobs in RESTARTING
> >>>>> state
> >>>>>>>>>>>>>>> - FLINK-3021 Fix class loading issue for streaming
> >>>>>> sources
> >>>>>>>>>>>>>>> - FLINK-2974 Add periodic offset committer for Kafka
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> (merged)
> >>>>>>>>>>>>>>> - FLINK-2977 Using reflection to load HBase Kerberos
> >>>>>> tokens
> >>>>>>>>>>>>>>> - FLINK-3024 Fix
> >>>>> TimestampExtractor.getCurrentWatermark()
> >>>>>>>>>> Behaviour
> >>>>>>>>>>>>>>> - FLINK-2967 Increase timeout for LOCAL_HOST address
> >>>>>>>> detection
> >>>>>>>>>>>> stratey
> >>>>>>>>>>>>>>> - FLINK-3025 [kafka consumer] Bump transitive
> >>>> ZkClient
> >>>>>>>>> dependency
> >>>>>>>>>>>>>>> (merged since my first email)
> >>>>>>>>>>>>>>> - FLINK-2989 job cancel button doesn't work on YARN
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> On Wed, Nov 18, 2015 at 2:35 PM, Ufuk Celebi <
> >>>>>>> uce@apache.org
> >>>>>>>>>
> >>>>>>>>>>> wrote:
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> @Suneel: I think that's OK for the next major
> >>>> release
> >>>>>> :)
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> On Wed, Nov 18, 2015 at 2:17 PM, Suneel Marthi <
> >>>>>>>>>>>>>> suneel.marthi@gmail.com>
> >>>>>>>>>>>>>>>> wrote:
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>> Would be nice to have Flink-2949 in the mix, but
> >>>> I
> >>>>>>> won't
> >>>>>>>> be
> >>>>>>>>>>> able
> >>>>>>>>>>>> to
> >>>>>>>>>>>>>> get
> >>>>>>>>>>>>>>>> to
> >>>>>>>>>>>>>>>>> it until early next week.
> >>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>> On Wed, Nov 18, 2015 at 7:49 AM, Till Rohrmann <
> >>>>>>>>>>>>> trohrmann@apache.org
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>> wrote:
> >>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>> @Vasia, do you mean FLINK-3013 or FLINK-3012?
> >>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>> Will merge PRs for FLINK-3036 and FLINK-3013
> >>>> this
> >>>>>>>>>> afternoon.
> >>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>> On Wed, Nov 18, 2015 at 1:47 PM, Stephan Ewen <
> >>>>>>>>>>>> sewen@apache.org>
> >>>>>>>>>>>>>>>> wrote:
> >>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>> +1 for a timely 0.10.1 release
> >>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>> I would like to add FLINK-2974 - periodic
> >>>> kafka
> >>>>>>>> offset
> >>>>>>>>>>>>> committer
> >>>>>>>>>>>>>>> for
> >>>>>>>>>>>>>>>>> case
> >>>>>>>>>>>>>>>>>>> where checkpointing is deactivated
> >>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>> On Wed, Nov 18, 2015 at 12:34 PM, Vasiliki
> >>>>>> Kalavri
> >>>>>>> <
> >>>>>>>>>>>>>>>>>>> vasilikikalavri@gmail.com> wrote:
> >>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>> Hey,
> >>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>> I would also add FLINK-3012 and FLINK-3036
> >>>>>> (both
> >>>>>>>>>> pending
> >>>>>>>>>>>>> PRs).
> >>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>> Thanks!
> >>>>>>>>>>>>>>>>>>>> -Vasia.
> >>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>> On 18 November 2015 at 12:24, Robert
> >>>> Metzger
> >>>>> <
> >>>>>>>>>>>>>>> rmetzger@apache.org>
> >>>>>>>>>>>>>>>>>>> wrote:
> >>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>> Hi,
> >>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>> I was wondering whether we should release
> >>>>>> Flink
> >>>>>>>>>> 0.10.1
> >>>>>>>>>>>>> soon,
> >>>>>>>>>>>>>> as
> >>>>>>>>>>>>>>>>> there
> >>>>>>>>>>>>>>>>>>> are
> >>>>>>>>>>>>>>>>>>>>> some issues we've identified:
> >>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>> (pending PRs)
> >>>>>>>>>>>>>>>>>>>>> - FLINK-3032: Flink does not start on
> >>>>> Hadoop
> >>>>>>>> 2.7.1
> >>>>>>>>>>> (HDP),
> >>>>>>>>>>>>> due
> >>>>>>>>>>>>>>> to
> >>>>>>>>>>>>>>>>>> class
> >>>>>>>>>>>>>>>>>>>>> conflict
> >>>>>>>>>>>>>>>>>>>>> - FLINK-3011, 3019, 3028 Cancel jobs in
> >>>>>>>> RESTARTING
> >>>>>>>>>>> state
> >>>>>>>>>>>>>>>>>>>>> - FLINK-3021 Fix class loading issue for
> >>>>>>>> streaming
> >>>>>>>>>>>> sources
> >>>>>>>>>>>>>>>>>>>>> - FLINK-2989 job cancel button doesn't
> >>>> work
> >>>>>> on
> >>>>>>>> YARN
> >>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>> (merged)
> >>>>>>>>>>>>>>>>>>>>> - FLINK-2977 Using reflection to load
> >>>> HBase
> >>>>>>>>> Kerberos
> >>>>>>>>>>>> tokens
> >>>>>>>>>>>>>>>>>>>>> - FLINK-3024 Fix
> >>>>>>>>>>> TimestampExtractor.getCurrentWatermark()
> >>>>>>>>>>>>>>>> Behaviour
> >>>>>>>>>>>>>>>>>>>>> - FLINK-2967 Increase timeout for
> >>>>> LOCAL_HOST
> >>>>>>>>> address
> >>>>>>>>>>>>>> detection
> >>>>>>>>>>>>>>>>>> stratey
> >>>>>>>>>>>>>>>>>>>>> - FLINK-3025 [kafka consumer] Bump
> >>>>> transitive
> >>>>>>>>>> ZkClient
> >>>>>>>>>>>>>>> dependency
> >>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>> Anything else that you would like to add?
> >>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>> Do you think we can manage to merge the
> >>>>> four
> >>>>>>> PRs
> >>>>>>>>>> until
> >>>>>>>>>>>>>> tomorrow
> >>>>>>>>>>>>>>>> and
> >>>>>>>>>>>>>>>>>>> then
> >>>>>>>>>>>>>>>>>>>>> start the RC?
> >>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>
> >>>>>>>>
> >>>>>>>
> >>>>>>
> >>>>>
> >>>>
> >>>
> >>
> >>
> >
>
>

--001a11c26464ab9ba205251f6f56--