Mailing-List: contact dev-help@flink.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@flink.apache.org
MIME-Version: 1.0
References: <CAKiyyaH_USuVD6etfehaRm6GLkGie=DCZG_G+5+bt5x+8s5XNQ@mail.gmail.com>
 <36D142F7-9C83-47A5-91CF-BDC1F4E0727D@data-artisans.com> <CAGr9p8BjE4sXm2AEiKwkPYSGKzYRnctNrYOpJgACi5SN-T5LYg@mail.gmail.com>
 <CAKiyyaFsvaFu5jNaY+ukayANtB26TGffLjUv5gN60w+fzSDY7w@mail.gmail.com>
 <CANMXwW3JiCV5KW+-pKcmbFkhs4+FUzHYfukDKEfyuQGs_y4Vgw@mail.gmail.com>
 <CAKiyyaEVJKYrWGivWWeW1aZWnj00qOH22KGx5RJR+prhLSrdCQ@mail.gmail.com>
 <CANMXwW2NbFq_2a6k8DrqQJ-=-jSQ79mz4HZ4L3ZyVcn=7UXeWw@mail.gmail.com>
 <CAELUF_Brg7be2Q9xKiQuEyLyoE8kkYPN4ui73Kd+b8+Cp0XL0g@mail.gmail.com>
 <CAC27z=NyfxyuJX4FX_6OfH6jFTo3Q+Q7Bi27mmX1aEtbv5cn2A@mail.gmail.com>
 <CAKiyyaE6pqurwPSU9A7U1g1G_yJV1A-OEdWuNMAUmpeGbAUyUA@mail.gmail.com> <CAGco--Z8x89N7apLXQcJpv1LjLV4k82jLaOAsKQEpcD=g6MP1A@mail.gmail.com>
In-Reply-To: <CAGco--Z8x89N7apLXQcJpv1LjLV4k82jLaOAsKQEpcD=g6MP1A@mail.gmail.com>
From: Aljoscha Krettek <aljoscha@apache.org>
Date: Tue, 26 Jul 2016 14:21:47 +0000
Message-ID: <CANMXwW3Zh3G-e_6LE_OmTwsz1UqhGb7JUh36aeHg1LA8MHjqDQ@mail.gmail.com>
Subject: Re: Flink 1.1.0 Preview RC0
To: dev@flink.apache.org, Ufuk Celebi <uce@apache.org>
Content-Type: multipart/alternative; boundary=94eb2c06d362885bc505388a9f03
archived-at: Tue, 26 Jul 2016 14:22:00 -0000

--94eb2c06d362885bc505388a9f03
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

I'm running tests locally now because of the Travis problems. Will merge as
soon as they pass for both the window slowness fix and the multiple metrics
reporters change.

On Tue, 26 Jul 2016 at 14:47 Maximilian Michels <mxm@apache.org> wrote:

> Yes, I'm done with the investigation for
> https://github.com/apache/flink/pull/2257. Merging before 6 pm CET.
>
> On Tue, Jul 26, 2016 at 10:52 AM, Ufuk Celebi <uce@apache.org> wrote:
> > The following PRs are still open. I will create the RC as soon as they
> > are merged. In any case I will fork off the release-1.1 branch by the
> > end of today (CET 6:00 PM), so that we are not blocking regular Flink
> > development.
> >
> > - https://github.com/apache/flink/pull/2257: Allow re-registration of
> > TMs at resource manager =3D> All good except for a Travis test issue.
> > @Max: You are looking into this, correct?
> >
> > - https://github.com/apache/flink/pull/2226: Move Metrics API to
> > separate module =3D> Chesnay updated this, we need a review here.
> > @Aljoscha: You were involved in this. Can you review this?
> >
> > - https://github.com/apache/flink/pull/2277: WindowOperator becomes
> > very slow with allowed lateness =3D> Needs another round of review.
> > @Aljoscha: You did the initial review. Can you review the addressed
> > comments again?
> >
> > - https://github.com/apache/flink/pull/2194 =3D> merging this now
> >
> > - https://github.com/apache/flink/pull/2278 =3D> merging this now
> >
> > - https://github.com/apache/flink/pull/2286 =3D> merging this now
> >
> >
> >
> > On Thu, Jul 21, 2016 at 4:44 PM, Till Rohrmann <trohrmann@apache.org>
> wrote:
> >> https://github.com/apache/flink/pull/2257 should almost be mergable.
> There
> >> is only an issue with one test which only occurs on Travis. But I thin=
k
> I
> >> found the culprit. Currently, testing it on Travis again.
> >>
> >> On Thu, Jul 21, 2016 at 3:53 PM, Flavio Pompermaier <
> pompermaier@okkam.it>
> >> wrote:
> >>
> >>> Maybe someone could complete FLINK-3901 - Added CsvRowInputFormat ?
> >>> This would be very useful to us..
> >>>
> >>> Best,
> >>> Flavio
> >>>
> >>> On Thu, Jul 21, 2016 at 3:31 PM, Aljoscha Krettek <aljoscha@apache.or=
g
> >
> >>> wrote:
> >>>
> >>> > Sounds good!
> >>> >
> >>> > This one I just merged: https://github.com/apache/flink/pull/2273
> (Only
> >>> > allow/require query
> >>> > for Tuple Stream in CassandraSink)
> >>> >
> >>> > For https://issues.apache.org/jira/browse/FLINK-4239 (Set Default
> >>> > Allowed Lateness to Zero and Make Triggers Non-Purging) I just
> opened a
> >>> PR:
> >>> > https://github.com/apache/flink/pull/2278
> >>> >
> >>> > On Thu, 21 Jul 2016 at 15:16 Ufuk Celebi <uce@apache.org> wrote:
> >>> >
> >>> > > Hey all,
> >>> > >
> >>> > > although there was no feedback for this preview RC, most of the
> issues
> >>> > > mentioned in the release are either resolved or open PRs. Once th=
e
> >>> > > following PRs have been merged, I would like to create RC1 and th=
e
> >>> > > release-1.1 branch. Feedback to this list is highly appreciated.
> >>> > >
> >>> > > Open PRs (awaiting review/review in progress):
> >>> > > - https://github.com/apache/flink/pull/2276: Forward suspend to
> >>> > > checkpoint coordinator
> >>> > > - https://github.com/apache/flink/pull/2257: Allow
> re-registration of
> >>> > > TMs at resource manager
> >>> > > - https://github.com/apache/flink/pull/2226: Move Metrics API to
> >>> > separate
> >>> > > module
> >>> > >
> >>> > > Open PRs (to be merged):
> >>> > > - https://github.com/apache/flink/pull/2273: Only allow/require
> query
> >>> > > for Tuple Stream in CassandraSink
> >>> > > - https://github.com/apache/flink/pull/2271: Add restarting time
> JM
> >>> > metric
> >>> > > - https://github.com/apache/flink/pull/2256: Don't clean up
> BlobStore
> >>> > > on BlobServer shut down
> >>> > > - https://github.com/apache/flink/pull/2194: Add savepoint header=
s
> >>> > >
> >>> > > Open issues w/o PRs:
> >>> > > - https://issues.apache.org/jira/browse/FLINK-4239: Set Default
> >>> > > Allowed Lateness to Zero and Make Triggers Non-Purging
> >>> > > - https://issues.apache.org/jira/browse/FLINK-4207: WindowOperato=
r
> >>> > > becomes very slow with allowed lateness
> >>> > >
> >>> > > @Aljoscha, Kostas: do you have an idea when these will be
> addressed?
> >>> > >
> >>> > > On Mon, Jul 18, 2016 at 11:05 AM, Aljoscha Krettek <
> >>> aljoscha@apache.org>
> >>> > > wrote:
> >>> > > > Not yet, but Kostas is investigating.
> >>> > > >
> >>> > > > On Fri, 15 Jul 2016 at 18:21 Ufuk Celebi <uce@apache.org> wrote=
:
> >>> > > >
> >>> > > >> Most actually have a pending PR, except:
> >>> > > >> https://issues.apache.org/jira/browse/FLINK-4207,
> >>> > > >> https://issues.apache.org/jira/browse/FLINK-4201.
> >>> > > >>
> >>> > > >> I will assign FLINK-4201 to myself and hope to fix it over the
> >>> > > >> weekend. The issue Stefan mentioned also has a pending PR by
> now.
> >>> > > >>
> >>> > > >> Hope to create the first RC next week... @Aljoscha, Stephan: a=
ny
> >>> idea
> >>> > > >> about fixing FLINK-4207?
> >>> > > >>
> >>> > > >> =E2=80=93 Ufuk
> >>> > > >>
> >>> > > >> On Fri, Jul 15, 2016 at 4:21 PM, Robert Metzger <
> >>> rmetzger@apache.org>
> >>> > > >> wrote:
> >>> > > >> > There are still 7 blockers for the release:
> >>> > > >> >
> >>> > > >>
> >>> > >
> >>> >
> >>>
> https://issues.apache.org/jira/browse/FLINK-4207?jql=3Dproject%20%3D%20FL=
INK%20AND%20resolution%20%3D%20Unresolved%20AND%20priority%20%3D%20Blocker%=
20ORDER%20BY%20key%20DESC
> >>> > > >> > most of them are assigned, some even have a pending pull
> request.
> >>> > > >> >
> >>> > > >> > On Thu, Jul 7, 2016 at 11:26 AM, Stefan Richter <
> >>> > > >> s.richter@data-artisans.com
> >>> > > >> >> wrote:
> >>> > > >> >
> >>> > > >> >> Hi Ufuk,
> >>> > > >> >>
> >>> > > >> >> Thanks for starting this thread. I think we should solve
> >>> > > >> >> https://issues.apache.org/jira/browse/FLINK-4166 <
> >>> > > >> >> https://issues.apache.org/jira/browse/FLINK-4166> for this
> >>> > version,
> >>> > > >> >> because it can easily become a blocker when running multipl=
e
> >>> Flink
> >>> > > >> >> applications on a clusters with HA  (see related issue for
> one
> >>> > > example).
> >>> > > >> >>
> >>> > > >> >> > Am 07.07.2016 um 11:02 schrieb Ufuk Celebi <uce@apache.or=
g
> >:
> >>> > > >> >> >
> >>> > > >> >> > Dear community,
> >>> > > >> >> >
> >>> > > >> >> > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
> >>> > > >> >> > FLINK 1.1.0 RC0
> >>> > > >> >> > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
> >>> > > >> >> >
> >>> > > >> >> > I've now created a "preview RC" for the upcoming 1.1.0
> release,
> >>> > > >> >> > including everything in master up to cb7824
> >>> > > >> >> > (https://github.com/uce/flink/tree/release-1.1.0-rc0).
> >>> > > >> >> >
> >>> > > >> >> > There are still some blocking issues and important pull
> >>> requests
> >>> > > to be
> >>> > > >> >> > merged (see below), but nevertheless I would like to star=
t
> >>> > testing
> >>> > > >> >> > Flink for the release in order to get the process going.
> >>> > > >> >> >
> >>> > > >> >> > In past major releases, we needed to create many release
> >>> > > candidates,
> >>> > > >> >> > often for fixing just some small issues. I would like to
> speed
> >>> up
> >>> > > the
> >>> > > >> >> > release process by collecting the last remaining issues
> with
> >>> the
> >>> > > RC0.
> >>> > > >> >> > Once these issues are resolved, we can start voting on RC=
1.
> >>> This
> >>> > is
> >>> > > >> >> > also when I will create the release-1.1 branch.
> >>> > > >> >> >
> >>> > > >> >> > We have a Wiki page
> >>> > > >> >> >
> https://cwiki.apache.org/confluence/display/FLINK/Releasing
> >>> > > >> containing
> >>> > > >> >> > some common release verification tasks.
> >>> > > >> >> >
> >>> > > >> >> > Also, production users are encouraged to participate in t=
he
> >>> > release
> >>> > > >> >> > verification process.
> >>> > > >> >> >
> >>> > > >> >> > Here are the preview binaries located:
> >>> > > >> >> > http://home.apache.org/~uce/flink-1.1.0-rc0/
> >>> > > >> >> >
> >>> > > >> >> > This is the staging repository:
> >>> > > >> >> >
> >>> > > >>
> >>> >
> https://repository.apache.org/content/repositories/orgapacheflink-1097
> >>> > > >> >> >
> >>> > > >> >> > To use the release candidate in an existing Maven project=
,
> set
> >>> > the
> >>> > > >> >> > Flink version to 1.1.0 and the repository URL to
> >>> > > >> >> >
> >>> > > >>
> >>> >
> https://repository.apache.org/content/repositories/orgapacheflink-1097.
> >>> > > >> >> >
> >>> > > >> >> > The POM should look like this:
> >>> > > >> >> >
> >>> > > >> >> > <properties>
> >>> > > >> >> >
> >>> > >  <project.build.sourceEncoding>UTF-8</project.build.sourceEncodin=
g>
> >>> > > >> >> >   <flink.version>1.1.0</flink.version>
> >>> > > >> >> > </properties>
> >>> > > >> >> >
> >>> > > >> >> > <repositories>
> >>> > > >> >> >   <repository>
> >>> > > >> >> >      <id>flink.release-staging</id>
> >>> > > >> >> >      <name>Apache Development Snapshot Repository</name>
> >>> > > >> >> >      <url>
> >>> > > >> >>
> >>> > >
> https://repository.apache.org/content/repositories/orgapacheflink-1097
> >>> > > >> >> </url>
> >>> > > >> >> >      <releases><enabled>true</enabled></releases>
> >>> > > >> >> >      <snapshots><enabled>false</enabled></snapshots>
> >>> > > >> >> >   </repository>
> >>> > > >> >> > </repositories>
> >>> > > >> >> >
> >>> > > >> >> > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
> >>> > > >> >> > OPEN ISSUES
> >>> > > >> >> > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
> >>> > > >> >> >
> >>> > > >> >> > The following are important to be fixed/merged before the
> >>> > release:
> >>> > > >> >> > - Savepoint headers: PR #2083 (
> >>> > > >> https://github.com/apache/flink/pull/2083
> >>> > > >> >> )
> >>> > > >> >> >  * includes FLINK-4154 (
> >>> > > >> https://issues.apache.org/jira/browse/FLINK-4154
> >>> > > >> >> )
> >>> > > >> >> > - Savepoint disposal with user class loader: #2194
> >>> > > >> >> > (https://github.com/apache/flink/pull/2194)
> >>> > > >> >> > - Cassandra sink exception check: #2183
> >>> > > >> >> > (https://github.com/apache/flink/pull/2183)
> >>> > > >> >> > - Prevent Metrics log flooding: #2135
> >>> > > >> >> > (https://github.com/apache/flink/pull/2135)
> >>> > > >> >> > - CEP serialization: #2202 (
> >>> > > https://github.com/apache/flink/pull/2202
> >>> > > >> )
> >>> > > >> >> > - HA BLOB store life-cycle:
> >>> > > >> >> https://issues.apache.org/jira/browse/FLINK-4150
> >>> > > >> >> >
> >>> > > >> >> > Nice to have:
> >>> > > >> >> > - Hash-based combine: #1517
> >>> > > https://github.com/apache/flink/pull/1517
> >>> > > >> >> >
> >>> > > >> >> > Feel free to add issues/PRs to the list and please report
> any
> >>> > > issues
> >>> > > >> >> > you encounter during testing in this thread.
> >>> > > >> >>
> >>> > > >> >>
> >>> > > >>
> >>> > >
> >>> >
> >>>
>

--94eb2c06d362885bc505388a9f03--