Mailing-List: contact dev-help@flink.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@flink.apache.org
MIME-Version: 1.0
References: 
 <CAGco--Z2H5GXGTCCk3jFbUBGRHmKje303DDb8zcDPzgk1OZt7A@mail.gmail.com>
 <CALuGr6Zbf0WaG5uZ6uojA5zzKM9fQS-1GDOy5Pd6jg5jxCepMQ@mail.gmail.com>
 <CAGco--bKwiToB=b7ugjVzs175eQAgc-pK2OjNsjHQPdb+Afhng@mail.gmail.com>
In-Reply-To: 
 <CAGco--bKwiToB=b7ugjVzs175eQAgc-pK2OjNsjHQPdb+Afhng@mail.gmail.com>
From: Aljoscha Krettek <aljoscha@apache.org>
Date: Mon, 15 Jun 2015 13:17:41 +0000
Message-ID: 
 <CANMXwW0_UURKnGQq1cb3b=b_KZjkLguCC08DWKRaR+p+N6VwHQ@mail.gmail.com>
Subject: Re: Testing Apache Flink 0.9.0-rc2
To: dev@flink.apache.org
Content-Type: multipart/alternative; boundary=001a11c2677cf36fad05188e48f3

--001a11c2677cf36fad05188e48f3
Content-Type: text/plain; charset=UTF-8

So, during my testing of the state checkpointing on a cluster I discovered
several things (bugs and features):

 - If you have a setup where the configuration is not synced to the workers
they do not pick up the state back-end configuration. The workers do not
respect the setting in the flink-cont.yaml on the master
- HDFS checkpointing works fine if you manually set it as the per-job
state-backend using setStateHandleProvider()
- If you manually set the stateHandleProvider to a "file://" backend, old
checkpoints will not be cleaned up, they will also not be cleaned up when a
job is finished.

On Sun, 14 Jun 2015 at 23:22 Maximilian Michels <mxm@apache.org> wrote:

> Hi Henry,
>
> This is just a dry run. The goal is to get everything in shape for a proper
> vote.
>
> Kind regards,
> Max
>
>
> On Sun, Jun 14, 2015 at 7:58 PM, Henry Saputra <henry.saputra@gmail.com>
> wrote:
>
> > Hi Max,
> >
> > Are you doing official VOTE on the RC on 0.9 release or this is just a
> dry
> > run?
> >
> >
> > - Henry
> >
> > On Sun, Jun 14, 2015 at 9:11 AM, Maximilian Michels <mxm@apache.org>
> > wrote:
> > > Dear Flink community,
> > >
> > > Here's the second release candidate for the 0.9.0 release. We haven't
> > had a
> > > formal vote on the previous release candidate but it received an
> implicit
> > > -1 because of a couple of issues.
> > >
> > > Thanks to the hard-working Flink devs these issues should be solved
> now.
> > > The following commits have been added to the second release candidate:
> > >
> > > f5f0709 [FLINK-2194] [type extractor] Excludes Writable type from
> > > WritableTypeInformation to be treated as an interface
> > > 40e2df5 [FLINK-2072] [ml] Adds quickstart guide
> > > af0fee5 [FLINK-2207] Fix TableAPI conversion documenation and further
> > > renamings for consistency.
> > > e513be7 [FLINK-2206] Fix incorrect counts of finished, canceled, and
> > failed
> > > jobs in webinterface
> > > ecfde6d [docs][release] update stable version to 0.9.0
> > > 4d8ae1c [docs] remove obsolete YARN link and cleanup download links
> > > f27fc81 [FLINK-2195] Configure Configurable Hadoop InputFormats
> > > ce3bc9c [streaming] [api-breaking] Minor DataStream cleanups
> > > 0edc0c8 [build] [streaming] Streaming parents dependencies pushed to
> > > children
> > > 6380b95 [streaming] Logging update for checkpointed streaming
> topologies
> > > 5993e28 [FLINK-2199] Escape UTF characters in Scala Shell welcome
> > squirrel.
> > > 80dd72d [FLINK-2196] [javaAPI] Moved misplaced SortPartitionOperator
> > class
> > > c8c2e2c [hotfix] Bring KMeansDataGenerator and KMeans quickstart in
> sync
> > > 77def9f [FLINK-2183][runtime] fix deadlock for concurrent slot release
> > > 87988ae [scripts] remove quickstart scripts
> > > f3a96de [streaming] Fixed streaming example jars packaging and
> > termination
> > > 255c554 [FLINK-2191] Fix inconsistent use of closure cleaner in Scala
> > > Streaming
> > > 1343f26 [streaming] Allow force-enabling checkpoints for iterative jobs
> > > c59d291 Fixed a few trivial issues:
> > > e0e6f59 [streaming] Optional iteration feedback partitioning added
> > > 348ac86 [hotfix] Fix YARNSessionFIFOITCase
> > > 80cf2c5 [ml] Makes StandardScalers state package private and reduce
> > > redundant code. Adjusts flink-ml readme.
> > > c83ee8a [FLINK-1844] [ml] Add MinMaxScaler implementation in the
> > > proprocessing package, test for the for the corresponding functionality
> > and
> > > documentation.
> > > ee7c417 [docs] [streaming] Added states and fold to the streaming docs
> > > fcca75c [docs] Fix some typos and grammar in the Streaming Programming
> > > Guide.
> > >
> > >
> > > Again, we need to test the new release candidate. Therefore, I've
> > created a
> > > new document where we keep track of our testing criteria for releases:
> > >
> >
> https://docs.google.com/document/d/162AZEX8lo0Njal10mmt9wzM5GYVL5WME-VfwGmwpBoA/edit
> > >
> > > Everyone who tested previously, could take a different task this time.
> > For
> > > some components we probably don't have to test again but, if in doubt,
> > > testing twice doesn't hurt.
> > >
> > > Happy testing :)
> > >
> > > Cheers,
> > > Max
> > >
> > > Git branch: release-0.9.0-rc2
> > > Release binaries: http://people.apache.org/~mxm/flink-0.9.0-rc2/
> > > Maven artifacts:
> > >
> https://repository.apache.org/content/repositories/orgapacheflink-1040/
> > > PGP public key for verifying the signatures:
> > > http://pgp.mit.edu/pks/lookup?op=vindex&search=0xDE976D18C2909CBF
> >
>

--001a11c2677cf36fad05188e48f3--