flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Robert Metzger <rmetz...@apache.org>
Subject Re: Forking off the 0.8 release branch.
Date Tue, 06 Jan 2015 19:03:27 GMT
>
> When you said "finish the release" meaning distribute/publish a TLP
> release in the incubating branch repo?


Marton did like 40% of the release work by now. I think it would be best if
Marton gets his chance to finish the release. Sadly, the TLP migration
seems to block it right now.
The release will look like a TLP release even though our repo is called
"incubator-flink". We already got our release directory, so the artifacts
won't be published from the incubator.
>From my point of view only the ldap group + nexus setup is missing for a
TLP release.

Once we have our new repo, we can just push the release branch to that repo
as well. The commit hash (thats the one really relevant for the release)
won't change.



On Tue, Jan 6, 2015 at 7:09 PM, Henry Saputra <henry.saputra@gmail.com>
wrote:

> Hi Márton,
>
> Yes, we could and should move to non-incubating repo. I think Robert
> and Stephan are working with Infra to make it happen.
>
> My question is more should we wait till migration happen or should we
> publish non-incubating release artifact to ASF diet and mvn central
> from our incubating source repository instead.
>
> - Henry
>
> On Mon, Jan 5, 2015 at 2:37 PM, Márton Balassi <balassi.marton@gmail.com>
> wrote:
> > I assume that infra graduation means that we can move to the
> non-incubating
> > repo as well.
> >
> > Also to the best of my knowledge the release is not connected to the
> > incubating repo itself. Of course it can be listed on github as well, but
> > what makes an apache release is that it can be downloaded from the apache
> > distribution mirrors (where it is signed correctly) and from maven
> central
> > (provided by the apache repository infrastructure). But please correct me
> > if I'm wrong.
> >
> > On Mon, Jan 5, 2015 at 11:20 PM, Henry Saputra <henry.saputra@gmail.com>
> > wrote:
> >
> >> When you said "finish the release" meaning distribute/publish a TLP
> >> release in the incubating branch repo?
> >>
> >> - Henry
> >>
> >> On Mon, Jan 5, 2015 at 6:38 AM, Robert Metzger <rmetzger@apache.org>
> >> wrote:
> >> > Allright .. I've asked infra and they plan to do the graduation this
> week
> >> > ("hopefully today/tomorrow").
> >> > If that is really going to happen in the next days, I would suggest to
> >> let
> >> > Marton finish the release. If there are any major delays due to INFRA,
> >> I'll
> >> > do the release.
> >> >
> >> > On Fri, Jan 2, 2015 at 10:37 AM, Robert Metzger <rmetzger@apache.org>
> >> wrote:
> >> >
> >> >> Thanks for the update.
> >> >>
> >> >> Happy new year to everyone.
> >> >>
> >> >> It seems that we have to wait for INFRA to finish the LDAP group
> >> creation
> >> >> for the new TLP first, since this is connected to the maven
> repository.
> >> >> If nothing happened until Monday, I'll ask infra on their IRC chat
if
> >> they
> >> >> can resolve the LDAP group creation.
> >> >>
> >> >>
> >> >> Robert
> >> >>
> >> >>
> >> >>
> >> >> On Fri, Jan 2, 2015 at 9:45 AM, Márton Balassi <
> >> balassi.marton@gmail.com>
> >> >> wrote:
> >> >>
> >> >>> Happy new year Flinkers,
> >> >>>
> >> >>> I'm sorry that I could not report any progress on the release yet.
> It
> >> was
> >> >>> finally clarified that we are actually blocked by the apache
> >> >>> infrastructure
> >> >>> at the moment. [1]
> >> >>>
> >> >>> [1] https://issues.apache.org/jira/browse/INFRA-8954
> >> >>>
> >> >>> Marton
> >> >>>
> >> >>> On Fri, Dec 19, 2014 at 11:00 PM, Henry Saputra <
> >> henry.saputra@gmail.com>
> >> >>> wrote:
> >> >>>
> >> >>> > Thanks for the update Marton.
> >> >>> >
> >> >>> > So with we are graduating it is coming as blessing but
> unfortunately
> >> >>> > adding more work to the release process.
> >> >>> >
> >> >>> > Please do let us know if you need any help with the release.
> >> >>> >
> >> >>> > - Henry
> >> >>> >
> >> >>> > On Fri, Dec 19, 2014 at 12:38 PM, Márton Balassi
> >> >>> > <balassi.marton@gmail.com> wrote:
> >> >>> > > +1 on quickstart, I'm having a look at it tomorrow.
> >> >>> > >
> >> >>> > > Robert also pointed out the the DISCLAIMER file (for
incubation,
> >> >>> > currently
> >> >>> > > also added to the distribution) is no longer needed neither
on
> the
> >> >>> master
> >> >>> > > nor on the release branch. Other minor things in the
repo
> regarding
> >> >>> the
> >> >>> > > graduation:
> >> >>> > >
> >> >>> > >   * Eliminating the incubating subscript from the project
> version
> >> >>> > >   * Updating the the docs (mostly mentioned in variables,
> >> sometimes in
> >> >>> > > since given version that should not be changed)
> >> >>> > >   * Updating the quickstart scripts (more related to
simply
> >> releasing)
> >> >>> > >
> >> >>> > > I'm deleting the DISCLAIMER from the repo and the assemblies,
> >> bumping
> >> >>> the
> >> >>> > > version and updating the parts of the docs that can be
done
> prior
> >> to
> >> >>> the
> >> >>> > > release.
> >> >>> > >
> >> >>> > > As for the state of the relese: With the help of Robert
I have
> >> >>> acquired
> >> >>> > the
> >> >>> > > necessary knowledge and set up the tools needed for the
> release. I
> >> >>> have
> >> >>> > > still minor issues with maven, but I'm confident that
the
> solution
> >> is
> >> >>> > near.
> >> >>> > > I also fell motivated to write down my experiences in
a
> >> documentation
> >> >>> to
> >> >>> > > spare some time for up and coming release managers.
> >> >>> > >
> >> >>> > > Best,
> >> >>> > >
> >> >>> > > Marton
> >> >>> > >
> >> >>> > > On Fri, Dec 19, 2014 at 9:13 PM, Aljoscha Krettek <
> >> >>> aljoscha@apache.org>
> >> >>> > > wrote:
> >> >>> > >>
> >> >>> > >> +1
> >> >>> > >>
> >> >>> > >> On Fri, Dec 19, 2014 at 8:45 PM, Robert Metzger <
> >> rmetzger@apache.org
> >> >>> >
> >> >>> > >> wrote:
> >> >>> > >> > Hi guys,
> >> >>> > >> >
> >> >>> > >> > I vote to make this issue a release blocker:
> >> >>> > >> > https://issues.apache.org/jira/browse/FLINK-1225
> >> >>> > >> > Two users ran into the issue within 2 days.
The quickstart is
> >> mean
> >> >>> to
> >> >>> > >> give
> >> >>> > >> > new users a good experience.
> >> >>> > >> >
> >> >>> > >> > On Tue, Dec 16, 2014 at 10:30 PM, Stephan Ewen
<
> >> sewen@apache.org>
> >> >>> > wrote:
> >> >>> > >> >>
> >> >>> > >> >> Hi!
> >> >>> > >> >>
> >> >>> > >> >> I forked a branch "release-0.8" and bumped
the master
> version
> >> to
> >> >>> > >> >> "0.9-incubating-SNAPSHOT".
> >> >>> > >> >>
> >> >>> > >> >> The closure cleaner is merged. Robert has
opened a PR for
> Kryo
> >> - I
> >> >>> > would
> >> >>> > >> >> suggest to merge that to "master", cherry-pick
to
> "release-0.8"
> >> >>> and
> >> >>> > >> then:
> >> >>> > >> >> Merry releasing!
> >> >>> > >> >>
> >> >>> > >> >> Greetings,
> >> >>> > >> >> Stephan
> >> >>> > >> >>
> >> >>> > >> >>
> >> >>> > >> >>
> >> >>> > >> >> On Tue, Dec 16, 2014 at 6:43 PM, Márton
Balassi <
> >> >>> > >> balassi.marton@gmail.com>
> >> >>> > >> >> wrote:
> >> >>> > >> >> >
> >> >>> > >> >> > @Timo&Stephan: The streaming code
uses this since last
> week
> >> [1],
> >> >>> > Timo
> >> >>> > >> >> > starting working on the issue prior
way before that - so
> it
> >> also
> >> >>> > has
> >> >>> > >> to
> >> >>> > >> >> do
> >> >>> > >> >> > with the streaming team pushing last
minute features to be
> >> >>> > honest...
> >> >>> > >> >> >
> >> >>> > >> >> > Then are we waiting for the Java Clousure
cleaner and the
> >> Kyro
> >> >>> > >> support, I
> >> >>> > >> >> > guess.
> >> >>> > >> >> > Aljoscha has already issued a PR for
the former, some
> >> additional
> >> >>> > >> testing
> >> >>> > >> >> is
> >> >>> > >> >> > needed from the looks of it. [2]
> >> >>> > >> >> >
> >> >>> > >> >> > [1]
> >> >>> > >> >> >
> >> >>> > >> >> >
> >> >>> > >> >>
> >> >>> > >>
> >> >>> >
> >> >>>
> >>
> https://git-wip-us.apache.org/repos/asf?p=incubator-flink.git;a=commit;h=51c1f67791307c2b9355171f7398d104befc8de5
> >> >>> > >> >> > [2] https://github.com/apache/incubator-flink/pull/269
> >> >>> > >> >> >
> >> >>> > >> >> > On Tue, Dec 16, 2014 at 5:52 PM, Timo
Walther <
> >> >>> flink@twalthr.com>
> >> >>> > >> wrote:
> >> >>> > >> >> > >
> >> >>> > >> >> > > Yes, I also think so. Stability
is more important.
> >> >>> > >> >> > >
> >> >>> > >> >> > > > Am 16.12.2014 um 17:46 schrieb
Stephan Ewen <
> >> >>> sewen@apache.org
> >> >>> > >:
> >> >>> > >> >> > > >
> >> >>> > >> >> > > > Yes, the fact that we both
did not realize that until
> now
> >> >>> sort
> >> >>> > of
> >> >>> > >> >> > reveals
> >> >>> > >> >> > > > that there are more implications
than anticipated.
> That
> >> is
> >> >>> > never
> >> >>> > >> good
> >> >>> > >> >> > for
> >> >>> > >> >> > > > "last minute" patches.
> >> >>> > >> >> > > >
> >> >>> > >> >> > > > That's why I would like to
merge it into 0.8.1 and
> 0.9,
> >> >>> rather
> >> >>> > >> than
> >> >>> > >> >> > 0.8.0
> >> >>> > >> >> > > > That gives the code a bit
more testing/use and us a
> bit
> >> more
> >> >>> > time
> >> >>> > >> to
> >> >>> > >> >> > > > thoroughly think the implications
through.
> >> >>> > >> >> > > >
> >> >>> > >> >> > > >> On Tue, Dec 16, 2014
at 5:30 PM, Timo Walther <
> >> >>> > flink@twalthr.com
> >> >>> > >> >
> >> >>> > >> >> > > wrote:
> >> >>> > >> >> > > >>
> >> >>> > >> >> > > >> Sorry I totally forgot
to check the streaming API. Do
> >> they
> >> >>> use
> >> >>> > >> the
> >> >>> > >> >> > > >> getXXXReturnTypes() methods
of the TypeExtractor?
> >> >>> > >> >> > > >>
> >> >>> > >> >> > > >>> Am 16.12.2014 um
17:23 schrieb Robert Metzger <
> >> >>> > >> rmetzger@apache.org
> >> >>> > >> >> >:
> >> >>> > >> >> > > >>>
> >> >>> > >> >> > > >>> I've worked on adding
Kryo support to Flink today. I
> >> would
> >> >>> > >> really
> >> >>> > >> >> > like
> >> >>> > >> >> > > to
> >> >>> > >> >> > > >>> include this into
the release. Many users were
> >> complaining
> >> >>> > about
> >> >>> > >> >> > this (
> >> >>> > >> >> > > >>> https://issues.apache.org/jira/browse/FLINK-610).
> >> >>> > >> >> > > >>>
> >> >>> > >> >> > > >>> I've based my work
on top of Timo's pull request. If
> >> we're
> >> >>> > not
> >> >>> > >> >> going
> >> >>> > >> >> > to
> >> >>> > >> >> > > >>> merge it, I will
have to rebase my code to the
> current
> >> >>> > master.
> >> >>> > >> ...
> >> >>> > >> >> > I'll
> >> >>> > >> >> > > >> try
> >> >>> > >> >> > > >>> and see if its easily
doable.
> >> >>> > >> >> > > >>>
> >> >>> > >> >> > > >>>> On Tue, Dec 16,
2014 at 5:02 PM, Stephan Ewen <
> >> >>> > >> sewen@apache.org>
> >> >>> > >> >> > > wrote:
> >> >>> > >> >> > > >>>>
> >> >>> > >> >> > > >>>> Yes, one thing
I just realized is that the
> streaming
> >> API
> >> >>> is
> >> >>> > not
> >> >>> > >> >> > aware
> >> >>> > >> >> > > of
> >> >>> > >> >> > > >>>> MissingTypeInfos
and it may cause weird behavior.
> >> >>> > >> >> > > >>>>
> >> >>> > >> >> > > >>>>> On Tue, Dec
16, 2014 at 4:56 PM, Fabian Hueske <
> >> >>> > >> >> fhueske@gmail.com>
> >> >>> > >> >> > > >> wrote:
> >> >>> > >> >> > > >>>>>
> >> >>> > >> >> > > >>>>> +1 for stability
first
> >> >>> > >> >> > > >>>>>
> >> >>> > >> >> > > >>>>> 2014-12-16
16:50 GMT+01:00 Stephan Ewen <
> >> >>> sewen@apache.org
> >> >>> > >:
> >> >>> > >> >> > > >>>>>>
> >> >>> > >> >> > > >>>>>> I am
currently working through the type hints
> pull
> >> >>> > request...
> >> >>> > >> >> > > >>>>>>
> >> >>> > >> >> > > >>>>>> Right
now, I actually think that we should
> postpone
> >> >>> this
> >> >>> > for
> >> >>> > >> the
> >> >>> > >> >> > > next
> >> >>> > >> >> > > >>>>>> bugfix
release.
> >> >>> > >> >> > > >>>>>>
> >> >>> > >> >> > > >>>>>> This
pull request changes actually some tricky
> >> >>> mechanisms
> >> >>> > in
> >> >>> > >> the
> >> >>> > >> >> > > Java
> >> >>> > >> >> > > >>>> API
> >> >>> > >> >> > > >>>>>> (it delays
the type information), which may have
> >> >>> > implications
> >> >>> > >> >> that
> >> >>> > >> >> > > me
> >> >>> > >> >> > > >>>> and
> >> >>> > >> >> > > >>>>>> Timo
have not fully caught now.
> >> >>> > >> >> > > >>>>>>
> >> >>> > >> >> > > >>>>>> I don't
feel Merging this last minute - this is
> >> prone
> >> >>> to
> >> >>> > >> >> introduce
> >> >>> > >> >> > > >>>>> errors.
> >> >>> > >> >> > > >>>>>>
> >> >>> > >> >> > > >>>>>> Any opinions
on that?
> >> >>> > >> >> > > >>>>>>
> >> >>> > >> >> > > >>>>>>
> >> >>> > >> >> > > >>>>>>
> >> >>> > >> >> > > >>>>>> On Tue,
Dec 16, 2014 at 3:36 PM, Stephan Ewen <
> >> >>> > >> sewen@apache.org
> >> >>> > >> >> >
> >> >>> > >> >> > > >>>> wrote:
> >> >>> > >> >> > > >>>>>>>
> >> >>> > >> >> > > >>>>>>> +1
for adding the closure cleaner...
> >> >>> > >> >> > > >>>>>>> Am
16.12.2014 15:23 schrieb "Aljoscha Krettek" <
> >> >>> > >> >> > > aljoscha@apache.org
> >> >>> > >> >> > > >>>>> :
> >> >>> > >> >> > > >>>>>>>
> >> >>> > >> >> > > >>>>>>> Do
we want the Java Closure Cleaner in 0.8 as
> well?
> >> >>> > >> >> > > >>>>>>>>
> >> >>> > >> >> > > >>>>>>>>
On Tue, Dec 16, 2014 at 10:30 AM, Márton
> Balassi
> >> >>> > >> >> > > >>>>>>>>
<balassi.marton@gmail.com> wrote:
> >> >>> > >> >> > > >>>>>>>>>
Cool, thanks.
> >> >>> > >> >> > > >>>>>>>>>
> >> >>> > >> >> > > >>>>>>>>>
On Tue, Dec 16, 2014 at 10:29 AM, Stephan
> Ewen <
> >> >>> > >> >> > sewen@apache.org
> >> >>> > >> >> > > >
> >> >>> > >> >> > > >>>>>>>>
wrote:
> >> >>> > >> >> > > >>>>>>>>>>
> >> >>> > >> >> > > >>>>>>>>>>
Hi!
> >> >>> > >> >> > > >>>>>>>>>>
> >> >>> > >> >> > > >>>>>>>>>>
The type hints PR is ready now, Timo made
> some
> >> >>> final
> >> >>> > >> >> > adjustments
> >> >>> > >> >> > > >>>>>>>>
yesterday
> >> >>> > >> >> > > >>>>>>>>>>
evening. I'll review and merge it now, then
> we
> >> can
> >> >>> > fork
> >> >>> > >> the
> >> >>> > >> >> > > >>>> branch.
> >> >>> > >> >> > > >>>>>>>>>>
> >> >>> > >> >> > > >>>>>>>>>>
Cheers,
> >> >>> > >> >> > > >>>>>>>>>>
Stephan
> >> >>> > >> >> > > >>>>>>>>>>
> >> >>> > >> >> > > >>>>>>>>>>
> >> >>> > >> >> > > >>>>>>>>>>
On Mon, Dec 15, 2014 at 10:08 PM, Márton
> >> Balassi <
> >> >>> > >> >> > > >>>>>>>>
balassi.marton@gmail.com
> >> >>> > >> >> > > >>>>>>>>>>
wrote:
> >> >>> > >> >> > > >>>>>>>>>>>
> >> >>> > >> >> > > >>>>>>>>>>>
Hey,
> >> >>> > >> >> > > >>>>>>>>>>>
> >> >>> > >> >> > > >>>>>>>>>>>
Checking the PRs listed by Stephan it seems
> >> every
> >> >>> > import
> >> >>> > >> >> one
> >> >>> > >> >> > > >>>> has
> >> >>> > >> >> > > >>>>>> been
> >> >>> > >> >> > > >>>>>>>>>>>
merged. As for the optional ones the
> following
> >> two
> >> >>> > are
> >> >>> > >> >> still
> >> >>> > >> >> > > >>>>>> pending:
> >> >>> > >> >> > > >>>>>>>>>>>
> >> >>> > >> >> > > >>>>>>>>>>>
> >> >>> > >> >> > > >>>>>>>>>>>
Add support for Subclasses, Interfaces,
> >> Abstract
> >> >>> > >> Classes as
> >> >>> > >> >> > > >>>> POJOs
> >> >>> > >> >> > > >>>>>>>>>>>
> >> >>> > >> >> > > >>>>>>>>>>>
[FLINK-1245] Introduce TypeHints for Java
> API
> >> >>> > operators
> >> >>> > >> >> > > >>>>>>>>>>>
> >> >>> > >> >> > > >>>>>>>>>>>
> >> >>> > >> >> > > >>>>>>>>>>>
Robert +1'd the TypeHints PR and Timo has
> just
> >> >>> > updated
> >> >>> > >> it.
> >> >>> > >> >> > > >>>> Should
> >> >>> > >> >> > > >>>>>> we
> >> >>> > >> >> > > >>>>>>>>
wait
> >> >>> > >> >> > > >>>>>>>>>>>
for it?
> >> >>> > >> >> > > >>>>>>>>>>>
> >> >>> > >> >> > > >>>>>>>>>>>
Cheers,
> >> >>> > >> >> > > >>>>>>>>>>>
> >> >>> > >> >> > > >>>>>>>>>>>
Marton
> >> >>> > >> >> > > >>>>>>>>>>>
> >> >>> > >> >> > > >>>>>>>>>>>
On Fri, Dec 12, 2014 at 2:29 PM, Ufuk
> Celebi <
> >> >>> > >> >> uce@apache.org
> >> >>> > >> >> > >
> >> >>> > >> >> > > >>>>>> wrote:
> >> >>> > >> >> > > >>>>>>>>>>>>
> >> >>> > >> >> > > >>>>>>>>>>>>
On Wed, Dec 10, 2014 at 7:35 PM, Stephan
> Ewen
> >> <
> >> >>> > >> >> > > >>>>> sewen@apache.org>
> >> >>> > >> >> > > >>>>>>>>>>
wrote:
> >> >>> > >> >> > > >>>>>>>>>>>>>
> >> >>> > >> >> > > >>>>>>>>>>>>>
> >> ----------------------------------------------
> >> >>> > >> >> > > >>>>>>>>>>>>>
Important Pull Requests to merge:
> >> >>> > >> >> > > >>>>>>>>>>>>>
> >> ----------------------------------------------
> >> >>> > >> >> > > >>>>>>>>>>>>>
> >> >>> > >> >> > > >>>>>>>>>>>>>
[FLINK-1287] LocalizableSplitAssigner
> prefers
> >> >>> > splits
> >> >>> > >> with
> >> >>> > >> >> > > >>>>> less
> >> >>> > >> >> > > >>>>>>>>>>
degrees
> >> >>> > >> >> > > >>>>>>>>>>>
of
> >> >>> > >> >> > > >>>>>>>>>>>>>
freedom
> >> >>> > >> >> > > >>>>>>>>>>>>>
> >> >>> > >> >> > > >>>>>>>>>>>>>
[FLINK-1305] [FLINK-1304] Test for
> >> >>> > HadoopInputWrapper
> >> >>> > >> and
> >> >>> > >> >> > > >>>>>>>>>>
NullWritable
> >> >>> > >> >> > > >>>>>>>>>>>>>
support
> >> >>> > >> >> > > >>>>>>>>>>>>>
> >> >>> > >> >> > > >>>>>>>>>>>>>
Upgraded HBase addon to HBase 0.98.x and
> new
> >> >>> Tuple
> >> >>> > >> APIs +
> >> >>> > >> >> > > >>>> fix
> >> >>> > >> >> > > >>>>>> of
> >> >>> > >> >> > > >>>>>>>>>>>>>
ExecutionEnvironment
> >> >>> > >> >> > > >>>>>>>>>>>>>
(this is partially merged, there are a few
> >> POM
> >> >>> > entries
> >> >>> > >> >> > > >>>>> missing
> >> >>> > >> >> > > >>>>>>>>
for
> >> >>> > >> >> > > >>>>>>>>>>>>
Hadoop 1
> >> >>> > >> >> > > >>>>>>>>>>>>>
support)
> >> >>> > >> >> > > >>>>>>>>>>>>
> >> >>> > >> >> > > >>>>>>>>>>>>
The first two PRs are still open. I will
> have
> >> a
> >> >>> > look at
> >> >>> > >> >> them
> >> >>> > >> >> > > >>>> as
> >> >>> > >> >> > > >>>>>>>>
well
> >> >>> > >> >> > > >>>>>>>>>>>>
(Robert already tested one).
> >> >>> > >> >> > > >>>>>>>>>>>>
> >> >>> > >> >> > > >>>>>>>>>>>>
@Robert:
> >> >>> > >> >> > > >>>>>>>>>>>>
Regarding the Hbase PR: Is it resolved by
> >> 1b69749
> >> >>> > >> ("Enable
> >> >>> > >> >> > > >>>>>>>>
flink-hbase
> >> >>> > >> >> > > >>>>>>>>>>>>
module for hadoop1 build as well")?
> >> >>> > >> >> > > >>>>>>>>>>>>
> >> >>> > >> >> > > >>>>>>>>>>>>
> >> >>> > >> >> > > >>>>>>>>>>>>
It would be nice if had a look at the
> >> remaining
> >> >>> > >> important
> >> >>> > >> >> > > >>>> ones
> >> >>> > >> >> > > >>>>>>>>
today.
> >> >>> > >> >> > > >>>>>>>>>>
:-)
> >> >>> > >> >> > > >>
> >> >>> > >> >> > >
> >> >>> > >> >> >
> >> >>> > >> >>
> >> >>> > >>
> >> >>> >
> >> >>>
> >> >>
> >> >>
> >>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message