flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Márton Balassi <balassi.mar...@gmail.com>
Subject Re: Forking off the 0.8 release branch.
Date Fri, 02 Jan 2015 08:45:11 GMT
Happy new year Flinkers,

I'm sorry that I could not report any progress on the release yet. It was
finally clarified that we are actually blocked by the apache infrastructure
at the moment. [1]

[1] https://issues.apache.org/jira/browse/INFRA-8954

Marton

On Fri, Dec 19, 2014 at 11:00 PM, Henry Saputra <henry.saputra@gmail.com>
wrote:

> Thanks for the update Marton.
>
> So with we are graduating it is coming as blessing but unfortunately
> adding more work to the release process.
>
> Please do let us know if you need any help with the release.
>
> - Henry
>
> On Fri, Dec 19, 2014 at 12:38 PM, Márton Balassi
> <balassi.marton@gmail.com> wrote:
> > +1 on quickstart, I'm having a look at it tomorrow.
> >
> > Robert also pointed out the the DISCLAIMER file (for incubation,
> currently
> > also added to the distribution) is no longer needed neither on the master
> > nor on the release branch. Other minor things in the repo regarding the
> > graduation:
> >
> >   * Eliminating the incubating subscript from the project version
> >   * Updating the the docs (mostly mentioned in variables, sometimes in
> > since given version that should not be changed)
> >   * Updating the quickstart scripts (more related to simply releasing)
> >
> > I'm deleting the DISCLAIMER from the repo and the assemblies, bumping the
> > version and updating the parts of the docs that can be done prior to the
> > release.
> >
> > As for the state of the relese: With the help of Robert I have acquired
> the
> > necessary knowledge and set up the tools needed for the release. I have
> > still minor issues with maven, but I'm confident that the solution is
> near.
> > I also fell motivated to write down my experiences in a documentation to
> > spare some time for up and coming release managers.
> >
> > Best,
> >
> > Marton
> >
> > On Fri, Dec 19, 2014 at 9:13 PM, Aljoscha Krettek <aljoscha@apache.org>
> > wrote:
> >>
> >> +1
> >>
> >> On Fri, Dec 19, 2014 at 8:45 PM, Robert Metzger <rmetzger@apache.org>
> >> wrote:
> >> > Hi guys,
> >> >
> >> > I vote to make this issue a release blocker:
> >> > https://issues.apache.org/jira/browse/FLINK-1225
> >> > Two users ran into the issue within 2 days. The quickstart is mean to
> >> give
> >> > new users a good experience.
> >> >
> >> > On Tue, Dec 16, 2014 at 10:30 PM, Stephan Ewen <sewen@apache.org>
> wrote:
> >> >>
> >> >> Hi!
> >> >>
> >> >> I forked a branch "release-0.8" and bumped the master version to
> >> >> "0.9-incubating-SNAPSHOT".
> >> >>
> >> >> The closure cleaner is merged. Robert has opened a PR for Kryo - I
> would
> >> >> suggest to merge that to "master", cherry-pick to "release-0.8" and
> >> then:
> >> >> Merry releasing!
> >> >>
> >> >> Greetings,
> >> >> Stephan
> >> >>
> >> >>
> >> >>
> >> >> On Tue, Dec 16, 2014 at 6:43 PM, Márton Balassi <
> >> balassi.marton@gmail.com>
> >> >> wrote:
> >> >> >
> >> >> > @Timo&Stephan: The streaming code uses this since last week
[1],
> Timo
> >> >> > starting working on the issue prior way before that - so it also
> has
> >> to
> >> >> do
> >> >> > with the streaming team pushing last minute features to be
> honest...
> >> >> >
> >> >> > Then are we waiting for the Java Clousure cleaner and the Kyro
> >> support, I
> >> >> > guess.
> >> >> > Aljoscha has already issued a PR for the former, some additional
> >> testing
> >> >> is
> >> >> > needed from the looks of it. [2]
> >> >> >
> >> >> > [1]
> >> >> >
> >> >> >
> >> >>
> >>
> https://git-wip-us.apache.org/repos/asf?p=incubator-flink.git;a=commit;h=51c1f67791307c2b9355171f7398d104befc8de5
> >> >> > [2] https://github.com/apache/incubator-flink/pull/269
> >> >> >
> >> >> > On Tue, Dec 16, 2014 at 5:52 PM, Timo Walther <flink@twalthr.com>
> >> wrote:
> >> >> > >
> >> >> > > Yes, I also think so. Stability is more important.
> >> >> > >
> >> >> > > > Am 16.12.2014 um 17:46 schrieb Stephan Ewen <sewen@apache.org
> >:
> >> >> > > >
> >> >> > > > Yes, the fact that we both did not realize that until
now sort
> of
> >> >> > reveals
> >> >> > > > that there are more implications than anticipated. That
is
> never
> >> good
> >> >> > for
> >> >> > > > "last minute" patches.
> >> >> > > >
> >> >> > > > That's why I would like to merge it into 0.8.1 and 0.9,
rather
> >> than
> >> >> > 0.8.0
> >> >> > > > That gives the code a bit more testing/use and us a
bit more
> time
> >> to
> >> >> > > > thoroughly think the implications through.
> >> >> > > >
> >> >> > > >> On Tue, Dec 16, 2014 at 5:30 PM, Timo Walther <
> flink@twalthr.com
> >> >
> >> >> > > wrote:
> >> >> > > >>
> >> >> > > >> Sorry I totally forgot to check the streaming API.
Do they use
> >> the
> >> >> > > >> getXXXReturnTypes() methods of the TypeExtractor?
> >> >> > > >>
> >> >> > > >>> Am 16.12.2014 um 17:23 schrieb Robert Metzger
<
> >> rmetzger@apache.org
> >> >> >:
> >> >> > > >>>
> >> >> > > >>> I've worked on adding Kryo support to Flink
today. I would
> >> really
> >> >> > like
> >> >> > > to
> >> >> > > >>> include this into the release. Many users were
complaining
> about
> >> >> > this (
> >> >> > > >>> https://issues.apache.org/jira/browse/FLINK-610).
> >> >> > > >>>
> >> >> > > >>> I've based my work on top of Timo's pull request.
If we're
> not
> >> >> going
> >> >> > to
> >> >> > > >>> merge it, I will have to rebase my code to the
current
> master.
> >> ...
> >> >> > I'll
> >> >> > > >> try
> >> >> > > >>> and see if its easily doable.
> >> >> > > >>>
> >> >> > > >>>> On Tue, Dec 16, 2014 at 5:02 PM, Stephan
Ewen <
> >> sewen@apache.org>
> >> >> > > wrote:
> >> >> > > >>>>
> >> >> > > >>>> Yes, one thing I just realized is that the
streaming API is
> not
> >> >> > aware
> >> >> > > of
> >> >> > > >>>> MissingTypeInfos and it may cause weird
behavior.
> >> >> > > >>>>
> >> >> > > >>>>> On Tue, Dec 16, 2014 at 4:56 PM, Fabian
Hueske <
> >> >> fhueske@gmail.com>
> >> >> > > >> wrote:
> >> >> > > >>>>>
> >> >> > > >>>>> +1 for stability first
> >> >> > > >>>>>
> >> >> > > >>>>> 2014-12-16 16:50 GMT+01:00 Stephan Ewen
<sewen@apache.org
> >:
> >> >> > > >>>>>>
> >> >> > > >>>>>> I am currently working through the
type hints pull
> request...
> >> >> > > >>>>>>
> >> >> > > >>>>>> Right now, I actually think that
we should postpone this
> for
> >> the
> >> >> > > next
> >> >> > > >>>>>> bugfix release.
> >> >> > > >>>>>>
> >> >> > > >>>>>> This pull request changes actually
some tricky mechanisms
> in
> >> the
> >> >> > > Java
> >> >> > > >>>> API
> >> >> > > >>>>>> (it delays the type information),
which may have
> implications
> >> >> that
> >> >> > > me
> >> >> > > >>>> and
> >> >> > > >>>>>> Timo have not fully caught now.
> >> >> > > >>>>>>
> >> >> > > >>>>>> I don't feel Merging this last minute
- this is prone to
> >> >> introduce
> >> >> > > >>>>> errors.
> >> >> > > >>>>>>
> >> >> > > >>>>>> Any opinions on that?
> >> >> > > >>>>>>
> >> >> > > >>>>>>
> >> >> > > >>>>>>
> >> >> > > >>>>>> On Tue, Dec 16, 2014 at 3:36 PM,
Stephan Ewen <
> >> sewen@apache.org
> >> >> >
> >> >> > > >>>> wrote:
> >> >> > > >>>>>>>
> >> >> > > >>>>>>> +1 for adding the closure cleaner...
> >> >> > > >>>>>>> Am 16.12.2014 15:23 schrieb
"Aljoscha Krettek" <
> >> >> > > aljoscha@apache.org
> >> >> > > >>>>> :
> >> >> > > >>>>>>>
> >> >> > > >>>>>>> Do we want the Java Closure
Cleaner in 0.8 as well?
> >> >> > > >>>>>>>>
> >> >> > > >>>>>>>> On Tue, Dec 16, 2014 at
10:30 AM, Márton Balassi
> >> >> > > >>>>>>>> <balassi.marton@gmail.com>
wrote:
> >> >> > > >>>>>>>>> Cool, thanks.
> >> >> > > >>>>>>>>>
> >> >> > > >>>>>>>>> On Tue, Dec 16, 2014
at 10:29 AM, Stephan Ewen <
> >> >> > sewen@apache.org
> >> >> > > >
> >> >> > > >>>>>>>> wrote:
> >> >> > > >>>>>>>>>>
> >> >> > > >>>>>>>>>> Hi!
> >> >> > > >>>>>>>>>>
> >> >> > > >>>>>>>>>> The type hints PR
is ready now, Timo made some final
> >> >> > adjustments
> >> >> > > >>>>>>>> yesterday
> >> >> > > >>>>>>>>>> evening. I'll review
and merge it now, then we can
> fork
> >> the
> >> >> > > >>>> branch.
> >> >> > > >>>>>>>>>>
> >> >> > > >>>>>>>>>> Cheers,
> >> >> > > >>>>>>>>>> Stephan
> >> >> > > >>>>>>>>>>
> >> >> > > >>>>>>>>>>
> >> >> > > >>>>>>>>>> On Mon, Dec 15,
2014 at 10:08 PM, Márton Balassi <
> >> >> > > >>>>>>>> balassi.marton@gmail.com
> >> >> > > >>>>>>>>>> wrote:
> >> >> > > >>>>>>>>>>>
> >> >> > > >>>>>>>>>>> Hey,
> >> >> > > >>>>>>>>>>>
> >> >> > > >>>>>>>>>>> Checking the
PRs listed by Stephan it seems every
> import
> >> >> one
> >> >> > > >>>> has
> >> >> > > >>>>>> been
> >> >> > > >>>>>>>>>>> merged. As for
the optional ones the following two
> are
> >> >> still
> >> >> > > >>>>>> pending:
> >> >> > > >>>>>>>>>>>
> >> >> > > >>>>>>>>>>>
> >> >> > > >>>>>>>>>>> Add support
for Subclasses, Interfaces, Abstract
> >> Classes as
> >> >> > > >>>> POJOs
> >> >> > > >>>>>>>>>>>
> >> >> > > >>>>>>>>>>> [FLINK-1245]
Introduce TypeHints for Java API
> operators
> >> >> > > >>>>>>>>>>>
> >> >> > > >>>>>>>>>>>
> >> >> > > >>>>>>>>>>> Robert +1'd
the TypeHints PR and Timo has just
> updated
> >> it.
> >> >> > > >>>> Should
> >> >> > > >>>>>> we
> >> >> > > >>>>>>>> wait
> >> >> > > >>>>>>>>>>> for it?
> >> >> > > >>>>>>>>>>>
> >> >> > > >>>>>>>>>>> Cheers,
> >> >> > > >>>>>>>>>>>
> >> >> > > >>>>>>>>>>> Marton
> >> >> > > >>>>>>>>>>>
> >> >> > > >>>>>>>>>>> On Fri, Dec
12, 2014 at 2:29 PM, Ufuk Celebi <
> >> >> uce@apache.org
> >> >> > >
> >> >> > > >>>>>> wrote:
> >> >> > > >>>>>>>>>>>>
> >> >> > > >>>>>>>>>>>> On Wed,
Dec 10, 2014 at 7:35 PM, Stephan Ewen <
> >> >> > > >>>>> sewen@apache.org>
> >> >> > > >>>>>>>>>> wrote:
> >> >> > > >>>>>>>>>>>>>
> >> >> > > >>>>>>>>>>>>> ----------------------------------------------
> >> >> > > >>>>>>>>>>>>> Important
Pull Requests to merge:
> >> >> > > >>>>>>>>>>>>> ----------------------------------------------
> >> >> > > >>>>>>>>>>>>>
> >> >> > > >>>>>>>>>>>>> [FLINK-1287]
LocalizableSplitAssigner prefers
> splits
> >> with
> >> >> > > >>>>> less
> >> >> > > >>>>>>>>>> degrees
> >> >> > > >>>>>>>>>>> of
> >> >> > > >>>>>>>>>>>>> freedom
> >> >> > > >>>>>>>>>>>>>
> >> >> > > >>>>>>>>>>>>> [FLINK-1305]
[FLINK-1304] Test for
> HadoopInputWrapper
> >> and
> >> >> > > >>>>>>>>>> NullWritable
> >> >> > > >>>>>>>>>>>>> support
> >> >> > > >>>>>>>>>>>>>
> >> >> > > >>>>>>>>>>>>> Upgraded
HBase addon to HBase 0.98.x and new Tuple
> >> APIs +
> >> >> > > >>>> fix
> >> >> > > >>>>>> of
> >> >> > > >>>>>>>>>>>>> ExecutionEnvironment
> >> >> > > >>>>>>>>>>>>> (this
is partially merged, there are a few POM
> entries
> >> >> > > >>>>> missing
> >> >> > > >>>>>>>> for
> >> >> > > >>>>>>>>>>>> Hadoop 1
> >> >> > > >>>>>>>>>>>>> support)
> >> >> > > >>>>>>>>>>>>
> >> >> > > >>>>>>>>>>>> The first
two PRs are still open. I will have a
> look at
> >> >> them
> >> >> > > >>>> as
> >> >> > > >>>>>>>> well
> >> >> > > >>>>>>>>>>>> (Robert
already tested one).
> >> >> > > >>>>>>>>>>>>
> >> >> > > >>>>>>>>>>>> @Robert:
> >> >> > > >>>>>>>>>>>> Regarding
the Hbase PR: Is it resolved by 1b69749
> >> ("Enable
> >> >> > > >>>>>>>> flink-hbase
> >> >> > > >>>>>>>>>>>> module for
hadoop1 build as well")?
> >> >> > > >>>>>>>>>>>>
> >> >> > > >>>>>>>>>>>>
> >> >> > > >>>>>>>>>>>> It would
be nice if had a look at the remaining
> >> important
> >> >> > > >>>> ones
> >> >> > > >>>>>>>> today.
> >> >> > > >>>>>>>>>> :-)
> >> >> > > >>
> >> >> > >
> >> >> >
> >> >>
> >>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message