flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Henry Saputra <henry.sapu...@gmail.com>
Subject Re: Forking off the 0.8 release branch.
Date Mon, 05 Jan 2015 22:20:36 GMT
When you said "finish the release" meaning distribute/publish a TLP
release in the incubating branch repo?

- Henry

On Mon, Jan 5, 2015 at 6:38 AM, Robert Metzger <rmetzger@apache.org> wrote:
> Allright .. I've asked infra and they plan to do the graduation this week
> ("hopefully today/tomorrow").
> If that is really going to happen in the next days, I would suggest to let
> Marton finish the release. If there are any major delays due to INFRA, I'll
> do the release.
>
> On Fri, Jan 2, 2015 at 10:37 AM, Robert Metzger <rmetzger@apache.org> wrote:
>
>> Thanks for the update.
>>
>> Happy new year to everyone.
>>
>> It seems that we have to wait for INFRA to finish the LDAP group creation
>> for the new TLP first, since this is connected to the maven repository.
>> If nothing happened until Monday, I'll ask infra on their IRC chat if they
>> can resolve the LDAP group creation.
>>
>>
>> Robert
>>
>>
>>
>> On Fri, Jan 2, 2015 at 9:45 AM, Márton Balassi <balassi.marton@gmail.com>
>> wrote:
>>
>>> Happy new year Flinkers,
>>>
>>> I'm sorry that I could not report any progress on the release yet. It was
>>> finally clarified that we are actually blocked by the apache
>>> infrastructure
>>> at the moment. [1]
>>>
>>> [1] https://issues.apache.org/jira/browse/INFRA-8954
>>>
>>> Marton
>>>
>>> On Fri, Dec 19, 2014 at 11:00 PM, Henry Saputra <henry.saputra@gmail.com>
>>> wrote:
>>>
>>> > Thanks for the update Marton.
>>> >
>>> > So with we are graduating it is coming as blessing but unfortunately
>>> > adding more work to the release process.
>>> >
>>> > Please do let us know if you need any help with the release.
>>> >
>>> > - Henry
>>> >
>>> > On Fri, Dec 19, 2014 at 12:38 PM, Márton Balassi
>>> > <balassi.marton@gmail.com> wrote:
>>> > > +1 on quickstart, I'm having a look at it tomorrow.
>>> > >
>>> > > Robert also pointed out the the DISCLAIMER file (for incubation,
>>> > currently
>>> > > also added to the distribution) is no longer needed neither on the
>>> master
>>> > > nor on the release branch. Other minor things in the repo regarding
>>> the
>>> > > graduation:
>>> > >
>>> > >   * Eliminating the incubating subscript from the project version
>>> > >   * Updating the the docs (mostly mentioned in variables, sometimes
in
>>> > > since given version that should not be changed)
>>> > >   * Updating the quickstart scripts (more related to simply releasing)
>>> > >
>>> > > I'm deleting the DISCLAIMER from the repo and the assemblies, bumping
>>> the
>>> > > version and updating the parts of the docs that can be done prior to
>>> the
>>> > > release.
>>> > >
>>> > > As for the state of the relese: With the help of Robert I have
>>> acquired
>>> > the
>>> > > necessary knowledge and set up the tools needed for the release. I
>>> have
>>> > > still minor issues with maven, but I'm confident that the solution
is
>>> > near.
>>> > > I also fell motivated to write down my experiences in a documentation
>>> to
>>> > > spare some time for up and coming release managers.
>>> > >
>>> > > Best,
>>> > >
>>> > > Marton
>>> > >
>>> > > On Fri, Dec 19, 2014 at 9:13 PM, Aljoscha Krettek <
>>> aljoscha@apache.org>
>>> > > wrote:
>>> > >>
>>> > >> +1
>>> > >>
>>> > >> On Fri, Dec 19, 2014 at 8:45 PM, Robert Metzger <rmetzger@apache.org
>>> >
>>> > >> wrote:
>>> > >> > Hi guys,
>>> > >> >
>>> > >> > I vote to make this issue a release blocker:
>>> > >> > https://issues.apache.org/jira/browse/FLINK-1225
>>> > >> > Two users ran into the issue within 2 days. The quickstart
is mean
>>> to
>>> > >> give
>>> > >> > new users a good experience.
>>> > >> >
>>> > >> > On Tue, Dec 16, 2014 at 10:30 PM, Stephan Ewen <sewen@apache.org>
>>> > wrote:
>>> > >> >>
>>> > >> >> Hi!
>>> > >> >>
>>> > >> >> I forked a branch "release-0.8" and bumped the master
version to
>>> > >> >> "0.9-incubating-SNAPSHOT".
>>> > >> >>
>>> > >> >> The closure cleaner is merged. Robert has opened a PR
for Kryo - I
>>> > would
>>> > >> >> suggest to merge that to "master", cherry-pick to "release-0.8"
>>> and
>>> > >> then:
>>> > >> >> Merry releasing!
>>> > >> >>
>>> > >> >> Greetings,
>>> > >> >> Stephan
>>> > >> >>
>>> > >> >>
>>> > >> >>
>>> > >> >> On Tue, Dec 16, 2014 at 6:43 PM, Márton Balassi <
>>> > >> balassi.marton@gmail.com>
>>> > >> >> wrote:
>>> > >> >> >
>>> > >> >> > @Timo&Stephan: The streaming code uses this since
last week [1],
>>> > Timo
>>> > >> >> > starting working on the issue prior way before that
- so it also
>>> > has
>>> > >> to
>>> > >> >> do
>>> > >> >> > with the streaming team pushing last minute features
to be
>>> > honest...
>>> > >> >> >
>>> > >> >> > Then are we waiting for the Java Clousure cleaner
and the Kyro
>>> > >> support, I
>>> > >> >> > guess.
>>> > >> >> > Aljoscha has already issued a PR for the former,
some additional
>>> > >> testing
>>> > >> >> is
>>> > >> >> > needed from the looks of it. [2]
>>> > >> >> >
>>> > >> >> > [1]
>>> > >> >> >
>>> > >> >> >
>>> > >> >>
>>> > >>
>>> >
>>> https://git-wip-us.apache.org/repos/asf?p=incubator-flink.git;a=commit;h=51c1f67791307c2b9355171f7398d104befc8de5
>>> > >> >> > [2] https://github.com/apache/incubator-flink/pull/269
>>> > >> >> >
>>> > >> >> > On Tue, Dec 16, 2014 at 5:52 PM, Timo Walther <
>>> flink@twalthr.com>
>>> > >> wrote:
>>> > >> >> > >
>>> > >> >> > > Yes, I also think so. Stability is more important.
>>> > >> >> > >
>>> > >> >> > > > Am 16.12.2014 um 17:46 schrieb Stephan
Ewen <
>>> sewen@apache.org
>>> > >:
>>> > >> >> > > >
>>> > >> >> > > > Yes, the fact that we both did not realize
that until now
>>> sort
>>> > of
>>> > >> >> > reveals
>>> > >> >> > > > that there are more implications than anticipated.
That is
>>> > never
>>> > >> good
>>> > >> >> > for
>>> > >> >> > > > "last minute" patches.
>>> > >> >> > > >
>>> > >> >> > > > That's why I would like to merge it into
0.8.1 and 0.9,
>>> rather
>>> > >> than
>>> > >> >> > 0.8.0
>>> > >> >> > > > That gives the code a bit more testing/use
and us a bit more
>>> > time
>>> > >> to
>>> > >> >> > > > thoroughly think the implications through.
>>> > >> >> > > >
>>> > >> >> > > >> On Tue, Dec 16, 2014 at 5:30 PM, Timo
Walther <
>>> > flink@twalthr.com
>>> > >> >
>>> > >> >> > > wrote:
>>> > >> >> > > >>
>>> > >> >> > > >> Sorry I totally forgot to check the
streaming API. Do they
>>> use
>>> > >> the
>>> > >> >> > > >> getXXXReturnTypes() methods of the
TypeExtractor?
>>> > >> >> > > >>
>>> > >> >> > > >>> Am 16.12.2014 um 17:23 schrieb
Robert Metzger <
>>> > >> rmetzger@apache.org
>>> > >> >> >:
>>> > >> >> > > >>>
>>> > >> >> > > >>> I've worked on adding Kryo support
to Flink today. I would
>>> > >> really
>>> > >> >> > like
>>> > >> >> > > to
>>> > >> >> > > >>> include this into the release.
Many users were complaining
>>> > about
>>> > >> >> > this (
>>> > >> >> > > >>> https://issues.apache.org/jira/browse/FLINK-610).
>>> > >> >> > > >>>
>>> > >> >> > > >>> I've based my work on top of Timo's
pull request. If we're
>>> > not
>>> > >> >> going
>>> > >> >> > to
>>> > >> >> > > >>> merge it, I will have to rebase
my code to the current
>>> > master.
>>> > >> ...
>>> > >> >> > I'll
>>> > >> >> > > >> try
>>> > >> >> > > >>> and see if its easily doable.
>>> > >> >> > > >>>
>>> > >> >> > > >>>> On Tue, Dec 16, 2014 at 5:02
PM, Stephan Ewen <
>>> > >> sewen@apache.org>
>>> > >> >> > > wrote:
>>> > >> >> > > >>>>
>>> > >> >> > > >>>> Yes, one thing I just realized
is that the streaming API
>>> is
>>> > not
>>> > >> >> > aware
>>> > >> >> > > of
>>> > >> >> > > >>>> MissingTypeInfos and it may
cause weird behavior.
>>> > >> >> > > >>>>
>>> > >> >> > > >>>>> On Tue, Dec 16, 2014 at
4:56 PM, Fabian Hueske <
>>> > >> >> fhueske@gmail.com>
>>> > >> >> > > >> wrote:
>>> > >> >> > > >>>>>
>>> > >> >> > > >>>>> +1 for stability first
>>> > >> >> > > >>>>>
>>> > >> >> > > >>>>> 2014-12-16 16:50 GMT+01:00
Stephan Ewen <
>>> sewen@apache.org
>>> > >:
>>> > >> >> > > >>>>>>
>>> > >> >> > > >>>>>> I am currently working
through the type hints pull
>>> > request...
>>> > >> >> > > >>>>>>
>>> > >> >> > > >>>>>> Right now, I actually
think that we should postpone
>>> this
>>> > for
>>> > >> the
>>> > >> >> > > next
>>> > >> >> > > >>>>>> bugfix release.
>>> > >> >> > > >>>>>>
>>> > >> >> > > >>>>>> This pull request changes
actually some tricky
>>> mechanisms
>>> > in
>>> > >> the
>>> > >> >> > > Java
>>> > >> >> > > >>>> API
>>> > >> >> > > >>>>>> (it delays the type
information), which may have
>>> > implications
>>> > >> >> that
>>> > >> >> > > me
>>> > >> >> > > >>>> and
>>> > >> >> > > >>>>>> Timo have not fully
caught now.
>>> > >> >> > > >>>>>>
>>> > >> >> > > >>>>>> I don't feel Merging
this last minute - this is prone
>>> to
>>> > >> >> introduce
>>> > >> >> > > >>>>> errors.
>>> > >> >> > > >>>>>>
>>> > >> >> > > >>>>>> Any opinions on that?
>>> > >> >> > > >>>>>>
>>> > >> >> > > >>>>>>
>>> > >> >> > > >>>>>>
>>> > >> >> > > >>>>>> On Tue, Dec 16, 2014
at 3:36 PM, Stephan Ewen <
>>> > >> sewen@apache.org
>>> > >> >> >
>>> > >> >> > > >>>> wrote:
>>> > >> >> > > >>>>>>>
>>> > >> >> > > >>>>>>> +1 for adding the
closure cleaner...
>>> > >> >> > > >>>>>>> Am 16.12.2014 15:23
schrieb "Aljoscha Krettek" <
>>> > >> >> > > aljoscha@apache.org
>>> > >> >> > > >>>>> :
>>> > >> >> > > >>>>>>>
>>> > >> >> > > >>>>>>> Do we want the
Java Closure Cleaner in 0.8 as well?
>>> > >> >> > > >>>>>>>>
>>> > >> >> > > >>>>>>>> On Tue, Dec
16, 2014 at 10:30 AM, Márton Balassi
>>> > >> >> > > >>>>>>>> <balassi.marton@gmail.com>
wrote:
>>> > >> >> > > >>>>>>>>> Cool, thanks.
>>> > >> >> > > >>>>>>>>>
>>> > >> >> > > >>>>>>>>> On Tue,
Dec 16, 2014 at 10:29 AM, Stephan Ewen <
>>> > >> >> > sewen@apache.org
>>> > >> >> > > >
>>> > >> >> > > >>>>>>>> wrote:
>>> > >> >> > > >>>>>>>>>>
>>> > >> >> > > >>>>>>>>>> Hi!
>>> > >> >> > > >>>>>>>>>>
>>> > >> >> > > >>>>>>>>>> The
type hints PR is ready now, Timo made some
>>> final
>>> > >> >> > adjustments
>>> > >> >> > > >>>>>>>> yesterday
>>> > >> >> > > >>>>>>>>>> evening.
I'll review and merge it now, then we can
>>> > fork
>>> > >> the
>>> > >> >> > > >>>> branch.
>>> > >> >> > > >>>>>>>>>>
>>> > >> >> > > >>>>>>>>>> Cheers,
>>> > >> >> > > >>>>>>>>>> Stephan
>>> > >> >> > > >>>>>>>>>>
>>> > >> >> > > >>>>>>>>>>
>>> > >> >> > > >>>>>>>>>> On
Mon, Dec 15, 2014 at 10:08 PM, Márton Balassi <
>>> > >> >> > > >>>>>>>> balassi.marton@gmail.com
>>> > >> >> > > >>>>>>>>>> wrote:
>>> > >> >> > > >>>>>>>>>>>
>>> > >> >> > > >>>>>>>>>>>
Hey,
>>> > >> >> > > >>>>>>>>>>>
>>> > >> >> > > >>>>>>>>>>>
Checking the PRs listed by Stephan it seems every
>>> > import
>>> > >> >> one
>>> > >> >> > > >>>> has
>>> > >> >> > > >>>>>> been
>>> > >> >> > > >>>>>>>>>>>
merged. As for the optional ones the following two
>>> > are
>>> > >> >> still
>>> > >> >> > > >>>>>> pending:
>>> > >> >> > > >>>>>>>>>>>
>>> > >> >> > > >>>>>>>>>>>
>>> > >> >> > > >>>>>>>>>>>
Add support for Subclasses, Interfaces, Abstract
>>> > >> Classes as
>>> > >> >> > > >>>> POJOs
>>> > >> >> > > >>>>>>>>>>>
>>> > >> >> > > >>>>>>>>>>>
[FLINK-1245] Introduce TypeHints for Java API
>>> > operators
>>> > >> >> > > >>>>>>>>>>>
>>> > >> >> > > >>>>>>>>>>>
>>> > >> >> > > >>>>>>>>>>>
Robert +1'd the TypeHints PR and Timo has just
>>> > updated
>>> > >> it.
>>> > >> >> > > >>>> Should
>>> > >> >> > > >>>>>> we
>>> > >> >> > > >>>>>>>> wait
>>> > >> >> > > >>>>>>>>>>>
for it?
>>> > >> >> > > >>>>>>>>>>>
>>> > >> >> > > >>>>>>>>>>>
Cheers,
>>> > >> >> > > >>>>>>>>>>>
>>> > >> >> > > >>>>>>>>>>>
Marton
>>> > >> >> > > >>>>>>>>>>>
>>> > >> >> > > >>>>>>>>>>>
On Fri, Dec 12, 2014 at 2:29 PM, Ufuk Celebi <
>>> > >> >> uce@apache.org
>>> > >> >> > >
>>> > >> >> > > >>>>>> wrote:
>>> > >> >> > > >>>>>>>>>>>>
>>> > >> >> > > >>>>>>>>>>>>
On Wed, Dec 10, 2014 at 7:35 PM, Stephan Ewen <
>>> > >> >> > > >>>>> sewen@apache.org>
>>> > >> >> > > >>>>>>>>>> wrote:
>>> > >> >> > > >>>>>>>>>>>>>
>>> > >> >> > > >>>>>>>>>>>>>
----------------------------------------------
>>> > >> >> > > >>>>>>>>>>>>>
Important Pull Requests to merge:
>>> > >> >> > > >>>>>>>>>>>>>
----------------------------------------------
>>> > >> >> > > >>>>>>>>>>>>>
>>> > >> >> > > >>>>>>>>>>>>>
[FLINK-1287] LocalizableSplitAssigner prefers
>>> > splits
>>> > >> with
>>> > >> >> > > >>>>> less
>>> > >> >> > > >>>>>>>>>> degrees
>>> > >> >> > > >>>>>>>>>>>
of
>>> > >> >> > > >>>>>>>>>>>>>
freedom
>>> > >> >> > > >>>>>>>>>>>>>
>>> > >> >> > > >>>>>>>>>>>>>
[FLINK-1305] [FLINK-1304] Test for
>>> > HadoopInputWrapper
>>> > >> and
>>> > >> >> > > >>>>>>>>>> NullWritable
>>> > >> >> > > >>>>>>>>>>>>>
support
>>> > >> >> > > >>>>>>>>>>>>>
>>> > >> >> > > >>>>>>>>>>>>>
Upgraded HBase addon to HBase 0.98.x and new
>>> Tuple
>>> > >> APIs +
>>> > >> >> > > >>>> fix
>>> > >> >> > > >>>>>> of
>>> > >> >> > > >>>>>>>>>>>>>
ExecutionEnvironment
>>> > >> >> > > >>>>>>>>>>>>>
(this is partially merged, there are a few POM
>>> > entries
>>> > >> >> > > >>>>> missing
>>> > >> >> > > >>>>>>>> for
>>> > >> >> > > >>>>>>>>>>>>
Hadoop 1
>>> > >> >> > > >>>>>>>>>>>>>
support)
>>> > >> >> > > >>>>>>>>>>>>
>>> > >> >> > > >>>>>>>>>>>>
The first two PRs are still open. I will have a
>>> > look at
>>> > >> >> them
>>> > >> >> > > >>>> as
>>> > >> >> > > >>>>>>>> well
>>> > >> >> > > >>>>>>>>>>>>
(Robert already tested one).
>>> > >> >> > > >>>>>>>>>>>>
>>> > >> >> > > >>>>>>>>>>>>
@Robert:
>>> > >> >> > > >>>>>>>>>>>>
Regarding the Hbase PR: Is it resolved by 1b69749
>>> > >> ("Enable
>>> > >> >> > > >>>>>>>> flink-hbase
>>> > >> >> > > >>>>>>>>>>>>
module for hadoop1 build as well")?
>>> > >> >> > > >>>>>>>>>>>>
>>> > >> >> > > >>>>>>>>>>>>
>>> > >> >> > > >>>>>>>>>>>>
It would be nice if had a look at the remaining
>>> > >> important
>>> > >> >> > > >>>> ones
>>> > >> >> > > >>>>>>>> today.
>>> > >> >> > > >>>>>>>>>> :-)
>>> > >> >> > > >>
>>> > >> >> > >
>>> > >> >> >
>>> > >> >>
>>> > >>
>>> >
>>>
>>
>>

Mime
View raw message