flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Till Rohrmann <trohrm...@apache.org>
Subject Re: [VOTE] Release Apache Flink 0.8.0 (RC1)
Date Mon, 12 Jan 2015 10:12:11 GMT
I only have to fix a last dead lock and then the fix should be working.

On Mon, Jan 12, 2015 at 11:06 AM, Ufuk Celebi <uce@apache.org> wrote:

> Thanks, Marton. Yes, I think
> https://issues.apache.org/jira/browse/FLINK-1376.
>
> Till has a fix coming up for it. Should we wait for this or postpone it to
> 0.8.1?
>
> – Ufuk
>
> On 12 Jan 2015, at 10:16, Márton Balassi <balassi.marton@gmail.com> wrote:
>
> > Based on the requests listed in this thread Stephan and myself
> > cherry-picked the following commits:
> >
> > 7634310 [FLINK-1266] Generalize DistributedFileSystem implementation
> > (rmetzger)
> > 40a2705 [FLINK-1266] Update mongodb link and address pull request
> comments
> > (rmetzger)
> > cd66ced [FLINK-1266] Properly pass the fs.defaulFS setting when
> > initializing … (rmetzger)
> > 3bf2d21 [FLINK-1266] More dependency exclusions (rmetzger)
> > e8ab5b7 [FLINK-1266] Backport fix to 0.8 (rmetzger)
> > 7cd0f47 [docs] Prepare documentation for 0.8 release (rmetzger)
> > e83ccd0 [FLINK-1385] Print warning if not resources are _currently_
> > available… (rmetzger)
> >
> > 4f9dcae [FLINK-1378] [scala] Fix type extraction for nested type
> parameters
> > (aljoscha)
> > fced2eb [FLINK-1378] Add support for Throwables in KryoSerializer
> (aljoscha)
> > ada35eb [FLINK-1378] [scala] Add support for Try[A]
> > (Success/Failure) (aljoscha)
> >
> > a64abe1 [docs] Update README and internals (scheduling) for graduation
> and
> > fi… (SephanEwen)
> > 4f95ce7 Fix typo in README.md (uce)
> >
> > Both of us committed some other fixes mainly for the dependencies and
> > licences, the distribution and the quickstarts. Pushing the results as
> soon
> > as the tests pass.
> >
> > Does anyone have any other issue that has to be included in the next
> > release candidate?
> >
> >
> > On Sat, Jan 10, 2015 at 7:34 PM, Robert Metzger <rmetzger@apache.org>
> wrote:
> >
> >> I've tested it on an empty YARN cluster, allocating more containers than
> >> available.
> >> Flink will then allocate as many containers as possible.
> >>
> >> On Sat, Jan 10, 2015 at 7:31 PM, Stephan Ewen <sewen@apache.org> wrote:
> >>
> >>> Seems reasonable. Have you tested it on a cluster with concurrent YARN
> >>> jobs?
> >>>
> >>> On Sat, Jan 10, 2015 at 7:28 PM, Robert Metzger <rmetzger@apache.org>
> >>> wrote:
> >>>
> >>>> I would really like to include this commit into the 0.8 release as
> >> well:
> >>>>
> >>>>
> >>>
> >>
> https://github.com/apache/flink/commit/ec2bb573d185429f8b3efe111850b8f0e67f2704
> >>>> A user is affected by this issue.
> >>>> If you agree, I can merge it.
> >>>>
> >>>> On Sat, Jan 10, 2015 at 7:25 PM, Stephan Ewen <sewen@apache.org>
> >> wrote:
> >>>>
> >>>>> I have gone through the code, cleaned up dependencies and made sure
> >>> that
> >>>>> all licenses are correctly handled.
> >>>>> The changes are in the public release-0.8 branch.
> >>>>>
> >>>>> From that side, the code is now good to go in my opinion.
> >>>>>
> >>>>>
> >>>>> Stephan
> >>>>>
> >>>>>
> >>>>> On Sat, Jan 10, 2015 at 12:30 PM, Robert Metzger <
> >> rmetzger@apache.org>
> >>>>> wrote:
> >>>>>
> >>>>>> I've updated the docs/_config.yml variables to reflect that hadoop2
> >>> is
> >>>>> now
> >>>>>> the default profile: https://github.com/apache/flink/pull/294
> >>>>>>
> >>>>>> On Fri, Jan 9, 2015 at 8:52 PM, Stephan Ewen <sewen@apache.org>
> >>> wrote:
> >>>>>>
> >>>>>>> Just as a heads up. I am almost through with checking
> >> dependencies
> >>>> and
> >>>>>>> licenses.
> >>>>>>> Will commit that later tonight or tomorrow.
> >>>>>>>
> >>>>>>> On Fri, Jan 9, 2015 at 7:09 PM, Stephan Ewen <sewen@apache.org>
> >>>> wrote:
> >>>>>>>
> >>>>>>>> I vote to include it as well. It is sort of vital for advanced
> >>> use
> >>>> of
> >>>>>> the
> >>>>>>>> Scala API.
> >>>>>>>>
> >>>>>>>> It is also an isolated change that does not affect other
> >>>> components,
> >>>>> so
> >>>>>>> it
> >>>>>>>> should be testable very well.
> >>>>>>>>
> >>>>>>>> On Fri, Jan 9, 2015 at 7:05 PM, Robert Metzger <
> >>>> rmetzger@apache.org>
> >>>>>>>> wrote:
> >>>>>>>>
> >>>>>>>>> I'd say yes because its affecting a user.
> >>>>>>>>>
> >>>>>>>>> On Fri, Jan 9, 2015 at 7:00 PM, Aljoscha Krettek <
> >>>>> aljoscha@apache.org
> >>>>>>>
> >>>>>>>>> wrote:
> >>>>>>>>>
> >>>>>>>>>> I have a fix for this issue:
> >>>>>>>>>>
> >>>>>>>>>
> >>>>>>>
> >>>>>>
> >>>>>
> >>>>
> >>>
> >>
> https://issues.apache.org/jira/browse/FLINK-1378?jql=project%20%3D%20FLINK
> >>>>>>>>>> and I think this should also make it into the 0.8.0 release.
> >>>>>>>>>>
> >>>>>>>>>> What do you think?
> >>>>>>>>>>
> >>>>>>>>>> On Fri, Jan 9, 2015 at 3:28 PM, Márton Balassi <
> >>>>>>>>> balassi.marton@gmail.com>
> >>>>>>>>>> wrote:
> >>>>>>>>>>> Sure, thanks Ufuk.
> >>>>>>>>>>>
> >>>>>>>>>>> On Fri, Jan 9, 2015 at 3:15 PM, Ufuk Celebi <
> >> uce@apache.org
> >>>>
> >>>>>> wrote:
> >>>>>>>>>>>
> >>>>>>>>>>>> Marton, could you also cherry-pick 7f659f6 and 7e08fa1
> >> for
> >>>> the
> >>>>>> next
> >>>>>>>>> RC?
> >>>>>>>>>>>> It's a minor update to the README describing the IDE
> >> setup.
> >>>>>>>>>>>>
> >>>>>>>>>>>> I will closed the respective issue FLINK-1109.
> >>>>>>>>>>>>
> >>>>>>>>>>>> On 08 Jan 2015, at 23:50, Henry Saputra <
> >>>>> henry.saputra@gmail.com
> >>>>>>>
> >>>>>>>>>> wrote:
> >>>>>>>>>>>>
> >>>>>>>>>>>>> Marton, could you close this VOTE thread by replying to
> >>> the
> >>>>>>>>> original
> >>>>>>>>>>>>> email and append [CANCEL] in the subject line.
> >>>>>>>>>>>>>
> >>>>>>>>>>>>> - Henry
> >>>>>>>>>>>>>
> >>>>>>>>>>>>> On Thu, Jan 8, 2015 at 9:35 AM, Márton Balassi <
> >>>>>>>>>> balassi.marton@gmail.com>
> >>>>>>>>>>>> wrote:
> >>>>>>>>>>>>>> Cherry-picked and tested: found no duplicate
> >>> dependencies
> >>>> in
> >>>>>>> lib,
> >>>>>>>>>> yarn
> >>>>>>>>>>>>>> uberjar build goes without the mentioned warns.
> >>>>>>>>>>>>>> Travis tests are passing, pushing soon.
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> On Thu, Jan 8, 2015 at 4:57 PM, Stephan Ewen <
> >>>>>> sewen@apache.org>
> >>>>>>>>>> wrote:
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> Nice.
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> @Marton: As soon as as you are done, I make a pass
> >> over
> >>>> the
> >>>>>>>>>> licenses...
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> Stephan
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> On Thu, Jan 8, 2015 at 4:42 PM, Robert Metzger <
> >>>>>>>>> rmetzger@apache.org
> >>>>>>>>>>>
> >>>>>>>>>>>>>>> wrote:
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> Allright. The travis tests are green and I tested it
> >>>> again
> >>>>>>> with
> >>>>>>>>>>>> Tachyon
> >>>>>>>>>>>>>>> on
> >>>>>>>>>>>>>>>> a cluster.
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> My pull request also fixes some of the issues
> >>> mentioned
> >>>>>>> earlier
> >>>>>>>>> in
> >>>>>>>>>>>> this
> >>>>>>>>>>>>>>>> thread by Stephan (the warnings from shading
> >> regarding
> >>>>>>> duplicate
> >>>>>>>>>>>>>>> classes).
> >>>>>>>>>>>>>>>> I can not fix all of them because some projects like
> >>>>> hadoop
> >>>>>>> just
> >>>>>>>>>> have
> >>>>>>>>>>>> the
> >>>>>>>>>>>>>>>> "conflicts" in their dependencies.
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> I'll merge the pull request to master.
> >>>>>>>>>>>>>>>> Marton can merge it to "release-0.8".
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> On Thu, Jan 8, 2015 at 2:42 PM, Stephan Ewen <
> >>>>>>> sewen@apache.org>
> >>>>>>>>>>>> wrote:
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>> Robert, can you let us know once the PR is merged?
> >>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>> Then we can start with the next steps...
> >>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>> On Thu, Jan 8, 2015 at 2:07 PM, Robert Metzger <
> >>>>>>>>>> rmetzger@apache.org>
> >>>>>>>>>>>>>>>>> wrote:
> >>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>> Please wait with merging 268. There is still a
> >> minor
> >>>>> open
> >>>>>>>>> issue.
> >>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>> On Thu, Jan 8, 2015 at 1:28 PM, Márton Balassi <
> >>>>>>>>>>>>>>>> balassi.marton@gmail.com
> >>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>> wrote:
> >>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>> +1 for merging PR 268, volunteering for the
> >> merge.
> >>> It
> >>>>>>> should
> >>>>>>>>>> also
> >>>>>>>>>>>>>>>> solve
> >>>>>>>>>>>>>>>>>> the
> >>>>>>>>>>>>>>>>>>> issue mentioned by Stephan with the yarn uberjar.
> >>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>> Updating the release scripts and doing a
> >>> double-check
> >>>>> on
> >>>>>>> the
> >>>>>>>>>>>>>>>> cosmetics.
> >>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>> On Thu, Jan 8, 2015 at 12:55 PM, Stephan Ewen <
> >>>>>>>>> sewen@apache.org
> >>>>>>>>>>>
> >>>>>>>>>>>>>>>>> wrote:
> >>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>> We just found and fixed another highly critical
> >>> bug.
> >>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>> I vote to also cherry pick commit
> >>>>>>>>>>>>>>>>>>>> 19066b520435528e104a69ccf372f56811123ee3
> >>>> ([FLINK-1371]
> >>>>>>>>>>>>>>>>>>>> [runtime] Fix KryoSerializer to not swallow
> >>>>>> EOFExceptions)
> >>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>> On Thu, Jan 8, 2015 at 11:55 AM, Robert Metzger
> >> <
> >>>>>>>>>>>>>>>> rmetzger@apache.org
> >>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>> wrote:
> >>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>> +1 for merging pull request 268. It makes Flink
> >>>> even
> >>>>>> more
> >>>>>>>>>>>>>>>>> compatible
> >>>>>>>>>>>>>>>>>>> with
> >>>>>>>>>>>>>>>>>>>>> hadoop.
> >>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>> regarding the documentation: I already updated
> >>> the
> >>>>>> build
> >>>>>>>>>>>>>>>>>> instructions.
> >>>>>>>>>>>>>>>>>>>> But
> >>>>>>>>>>>>>>>>>>>>> we should double check everything again.
> >>>>>>>>>>>>>>>>>>>>> I probably won't have time to look into this
> >>> today
> >>>>>>> however.
> >>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>> On Thu, Jan 8, 2015 at 11:50 AM, Stephan Ewen <
> >>>>>>>>>>>>>>> sewen@apache.org>
> >>>>>>>>>>>>>>>>>>> wrote:
> >>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>> After the dependencies are cleaned up
> >> (Robert's
> >>>> pull
> >>>>>>>>> request
> >>>>>>>>>>>>>>>>>>>>>> https://github.com/apache/flink/pull/268
> >> solves
> >>>>>> that),
> >>>>>>> we
> >>>>>>>>>>>>>>> need
> >>>>>>>>>>>>>>>>> to
> >>>>>>>>>>>>>>>>>>> also
> >>>>>>>>>>>>>>>>>>>>> do
> >>>>>>>>>>>>>>>>>>>>>> the following:
> >>>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>> - Make a pass over dependencies to ensure that
> >>>>> NOTICE
> >>>>>>> and
> >>>>>>>>>>>>>>>>> LICENSE
> >>>>>>>>>>>>>>>>>>>> files
> >>>>>>>>>>>>>>>>>>>>>> are up to date (both source and bin
> >>> distribution)
> >>>>>>>>>>>>>>>>>>>>>> - Adjust the variables in the docs to reflect
> >>> the
> >>>>> fact
> >>>>>>>>> that
> >>>>>>>>>>>>>>>>>> hadoop2
> >>>>>>>>>>>>>>>>>>> is
> >>>>>>>>>>>>>>>>>>>>> now
> >>>>>>>>>>>>>>>>>>>>>> the default profile
> >>>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>> I would volunteer for the first task.
> >>>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>> Stephan
> >>>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>> On Wed, Jan 7, 2015 at 10:01 PM, Stephan Ewen
> >> <
> >>>>>>>>>>>>>>>> sewen@apache.org>
> >>>>>>>>>>>>>>>>>>>> wrote:
> >>>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>>> I also see a warning when building the yarn
> >> fat
> >>>>> jar.
> >>>>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>>> This is a consequence of the duplicate
> >>>>> dependencies.
> >>>>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING] servlet-api-3.0.20100224.jar,
> >>>>>>>>>>>>>>>>>>> javax.servlet-api-3.0.1.jar,
> >>>>>>>>>>>>>>>>>>>>>>> javax.servlet-3.1.jar, servlet-api-2.5.jar
> >>> define
> >>>>> 42
> >>>>>>>>>>>>>>>>> overlappping
> >>>>>>>>>>>>>>>>>>>>>> classes:
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING]   - javax.servlet.http.Cookie
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING]   -
> >>>>>>> javax.servlet.http.HttpSessionBindingEvent
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING]   -
> >> javax.servlet.http.NoBodyResponse
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING]   - javax.servlet.ServletContext
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING]   -
> >> javax.servlet.ServletOutputStream
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING]   -
> >>>>> javax.servlet.http.HttpSessionListener
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING]   -
> >>>> javax.servlet.http.HttpSessionContext
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING]   - javax.servlet.FilterChain
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING]   - javax.servlet.GenericServlet
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING]   -
> >>>>>>>>> javax.servlet.http.HttpServletRequestWrapper
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING]   - 32 more...
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING] hadoop-yarn-api-2.2.0.jar,
> >>>>>>>>>>>>>>>>> hadoop-yarn-common-2.2.0.jar
> >>>>>>>>>>>>>>>>>>>>> define
> >>>>>>>>>>>>>>>>>>>>>> 3
> >>>>>>>>>>>>>>>>>>>>>>> overlappping classes:
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING]   -
> >>>>>> org.apache.hadoop.yarn.util.package-info
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING]   -
> >>>>>>>>> org.apache.hadoop.yarn.factories.package-info
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING]   -
> >>>>>>>>>>>>>>>>>>
> >>> org.apache.hadoop.yarn.factory.providers.package-info
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING] asm-4.0.jar, asm-3.1.jar define 21
> >>>>>>> overlappping
> >>>>>>>>>>>>>>>>>> classes:
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING]   - org.objectweb.asm.Type
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING]   -
> >>> org.objectweb.asm.AnnotationVisitor
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING]   - org.objectweb.asm.MethodVisitor
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING]   - org.objectweb.asm.Attribute
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING]   - org.objectweb.asm.FieldWriter
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING]   -
> >>>>>>> org.objectweb.asm.signature.SignatureWriter
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING]   - org.objectweb.asm.MethodWriter
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING]   - org.objectweb.asm.Edge
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING]   - org.objectweb.asm.Handler
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING]   - org.objectweb.asm.ByteVector
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING]   - 11 more...
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING] javax.servlet-api-3.0.1.jar,
> >>>>>>>>>>>>>>> javax.servlet-3.1.jar,
> >>>>>>>>>>>>>>>>>>>>>>> servlet-api-3.0.20100224.jar define 32
> >>>> overlappping
> >>>>>>>>>>>>>>> classes:
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING]   -
> >>>>> javax.servlet.annotation.HttpConstraint
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING]   - javax.servlet.DispatcherType
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING]   -
> >>>>>>>>>>>>>>>>> javax.servlet.descriptor.JspPropertyGroupDescriptor
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING]   - javax.servlet.Registration
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING]   -
> >> javax.servlet.SessionTrackingMode
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING]   -
> >>>>>>>>>>>>>>>>>>>>>
> >>>>>>> javax.servlet.annotation.ServletSecurity$EmptyRoleSemantic
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING]   -
> >>>> javax.servlet.annotation.HandlesTypes
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING]   -
> >> javax.servlet.ServletRegistration
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING]   -
> >>>>>> javax.servlet.annotation.ServletSecurity
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING]   -
> >>>>>> javax.servlet.ServletContainerInitializer
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING]   - 22 more...
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING] jasper-compiler-5.5.23.jar,
> >>>>>>>>>>>>>>>> jasper-runtime-5.5.23.jar
> >>>>>>>>>>>>>>>>>>>> define
> >>>>>>>>>>>>>>>>>>>>> 1
> >>>>>>>>>>>>>>>>>>>>>>> overlappping classes:
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING]   -
> >>>> org.apache.jasper.compiler.Localizer
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING] commons-collections-3.2.1.jar,
> >>>>>>>>>>>>>>>>>>> commons-beanutils-1.7.0.jar,
> >>>>>>>>>>>>>>>>>>>>>>> commons-beanutils-core-1.8.0.jar define 10
> >>>>>> overlappping
> >>>>>>>>>>>>>>>>> classes:
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING]   -
> >>>>>>>>>>>>>>>>> org.apache.commons.collections.FastHashMap$EntrySet
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING]   -
> >>>>>>>>>>>>>>>> org.apache.commons.collections.FastHashMap$KeySet
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING]   -
> >>>>>> org.apache.commons.collections.ArrayStack
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING]   -
> >>>>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>
> >>>>>>>
> >>>>>>
> >>>>>
> >>>>
> >>>
> >>
> org.apache.commons.collections.FastHashMap$CollectionView$CollectionViewIterator
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING]   -
> >>>>>>>>>>>>>>>> org.apache.commons.collections.FastHashMap$Values
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING]   -
> >>>>>>>>>>>>>>>>>>>>
> >>>>>> org.apache.commons.collections.FastHashMap$CollectionView
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING]   -
> >>>>>>>>> org.apache.commons.collections.FastHashMap$1
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING]   -
> >>>> org.apache.commons.collections.Buffer
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING]   -
> >>>>>>> org.apache.commons.collections.FastHashMap
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING]   -
> >>>>>>>>>>>>>>>>>>>
> >>>> org.apache.commons.collections.BufferUnderflowException
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING] commons-beanutils-1.7.0.jar,
> >>>>>>>>>>>>>>>>>>>> commons-beanutils-core-1.8.0.jar
> >>>>>>>>>>>>>>>>>>>>>>> define 82 overlappping classes:
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING]   -
> >>>>>>>>> org.apache.commons.beanutils.ConvertUtilsBean
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING]   -
> >>>>>>>>>>>>>>>>>>>>
> >>>>> org.apache.commons.beanutils.converters.SqlTimeConverter
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING]   -
> >>>>> org.apache.commons.beanutils.Converter
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING]   -
> >>>>>>>>>>>>>>>>>>>>>
> >>>>>>> org.apache.commons.beanutils.converters.FloatArrayConverter
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING]   -
> >>>>>>>>>>>>>>>> org.apache.commons.beanutils.NestedNullException
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING]   -
> >>>>>>>>>>>>>>>>> org.apache.commons.beanutils.ConvertingWrapDynaBean
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING]   -
> >>>>>>>>>>>>>>>>>>>>>
> >>>>>>> org.apache.commons.beanutils.converters.LongArrayConverter
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING]   -
> >>>>>>>>>>>>>>>>>>>>
> >>>>> org.apache.commons.beanutils.converters.SqlDateConverter
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING]   -
> >>>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>> org.apache.commons.beanutils.converters.BooleanArrayConverter
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING]   -
> >>>>>>>>>>>>>>>>>>>
> >>>> org.apache.commons.beanutils.converters.StringConverter
> >>>>>>>>>>>>>>>>>>>>>>> [WARNING]   - 72 more...
> >>>>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>>> On Wed, Jan 7, 2015 at 9:08 PM, Robert
> >> Metzger
> >>> <
> >>>>>>>>>>>>>>>>>>> rmetzger@apache.org>
> >>>>>>>>>>>>>>>>>>>>>>> wrote:
> >>>>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>>>> ... I did some more checks:
> >>>>>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>>>> The hadoop200alpha version has some issues
> >>> with
> >>>>> the
> >>>>>>>>> hadoop
> >>>>>>>>>>>>>>>>>>>> dependency
> >>>>>>>>>>>>>>>>>>>>>>>> exclusions. I fixed the issues in this pull
> >>>>> request:
> >>>>>>>>>>>>>>>>>>>>>>>> https://github.com/apache/flink/pull/268.
> >> The
> >>>>>>>>> dependency
> >>>>>>>>>>>>>>>>>>> exclusions
> >>>>>>>>>>>>>>>>>>>>> for
> >>>>>>>>>>>>>>>>>>>>>>>> hadoop are basically disabled because they
> >> are
> >>>>>>>>> overwritten
> >>>>>>>>>>>>>>>> by
> >>>>>>>>>>>>>>>>>> the
> >>>>>>>>>>>>>>>>>>>>>>>> hadoop200alpha profile. This causes issues
> >>> like
> >>>>> two
> >>>>>>> asm
> >>>>>>>>>>>>>>>>> versions
> >>>>>>>>>>>>>>>>>>>> (4.0
> >>>>>>>>>>>>>>>>>>>>>> and
> >>>>>>>>>>>>>>>>>>>>>>>> 3.2) in the lib/ folder.
> >>>>>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>>>> Very cosmetic:
> >>>>>>>>>>>>>>>>>>>>>>>> - We can update the urls in the README.txt /
> >>>>>> README.md
> >>>>>>>>> of
> >>>>>>>>>>>>>>>> the
> >>>>>>>>>>>>>>>>>>> binary
> >>>>>>>>>>>>>>>>>>>>>>>> releases. They contain
> >>>>>>>>>>>>>>>>>>>>>>>> http://flink.incubator.apache.org
> >>>>>>>>>>>>>>>>>>>>>>>> https://github.com/apache/incubator-flink
> >>>>>>>>>>>>>>>>>>>>>>>> user@flink.incubator.apache.org
> >>>>>>>>>>>>>>>>>>>>>>>> dev@flink.incubator.apache.org
> >>>>>>>>>>>>>>>>>>>>>>>> Which all don't need the "incubator" anymore
> >>>>>>>>> (mailinglists
> >>>>>>>>>>>>>>>>>> should
> >>>>>>>>>>>>>>>>>>>> work
> >>>>>>>>>>>>>>>>>>>>>> as
> >>>>>>>>>>>>>>>>>>>>>>>> well, but we need to verify)
> >>>>>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>>>> Positive checks:
> >>>>>>>>>>>>>>>>>>>>>>>> - No incubator notices
> >>>>>>>>>>>>>>>>>>>>>>>> - Example plan preview is working for all
> >>>> examples
> >>>>>>>>>>>>>>>>>>>>>>>> - All examples are running with build-in
> >> data,
> >>>>>>> submitted
> >>>>>>>>>>>>>>>> from
> >>>>>>>>>>>>>>>>>> the
> >>>>>>>>>>>>>>>>>>>> web
> >>>>>>>>>>>>>>>>>>>>>>>> interface
> >>>>>>>>>>>>>>>>>>>>>>>> - scala examples (some)
> >>>>>>>>>>>>>>>>>>>>>>>> - streaming examples (some)
> >>>>>>>>>>>>>>>>>>>>>>>> - No exceptions or WARN log messages
> >> occurred
> >>>>> after
> >>>>>> a
> >>>>>>>>>>>>>>> "start
> >>>>>>>>>>>>>>>>> jm
> >>>>>>>>>>>>>>>>>> /
> >>>>>>>>>>>>>>>>>>>> web
> >>>>>>>>>>>>>>>>>>>>>> -->
> >>>>>>>>>>>>>>>>>>>>>>>> all java batch examples --> stop everything"
> >>>>> cycle.
> >>>>>>>>>>>>>>>>>>>>>>>> - ./bin/flink also works for the wordcount
> >>>> example
> >>>>>> ;)
> >>>>>>>>>>>>>>>>>>>>>>>> - no binaries in the src archive
> >>>>>>>>>>>>>>>>>>>>>>>> - the source archive builds (mvn clean
> >>> install)
> >>>>>>>>> (including
> >>>>>>>>>>>>>>>> rat
> >>>>>>>>>>>>>>>>>>>> license
> >>>>>>>>>>>>>>>>>>>>>>>> header check, checkstyle and all tests)
> >>>>>>>>>>>>>>>>>>>>>>>> - gpg signatures are valid:  gpg --verify
> >>>>>>>>>>>>>>>>>> flink-0.8.0-src.tgz.asc
> >>>>>>>>>>>>>>>>>>>>>>>> flink-0.8.0-src.tgz
> >>>>>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>>>> On Wed, Jan 7, 2015 at 7:55 PM, Robert
> >>> Metzger <
> >>>>>>>>>>>>>>>>>>> rmetzger@apache.org
> >>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>>>> wrote:
> >>>>>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>>>>> -1
> >>>>>>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>>>>> There is a major issue with the hadoop1 and
> >>>>> hadoop2
> >>>>>>>>>>>>>>>>> versions:
> >>>>>>>>>>>>>>>>>> We
> >>>>>>>>>>>>>>>>>>>>> made
> >>>>>>>>>>>>>>>>>>>>>>>>> hadoop2 the default profile, so the 0.8.0
> >>>> version
> >>>>>>> will
> >>>>>>>>>>>>>>>> pull
> >>>>>>>>>>>>>>>>>> the
> >>>>>>>>>>>>>>>>>>>>>> hadoop2
> >>>>>>>>>>>>>>>>>>>>>>>>> dependencies.
> >>>>>>>>>>>>>>>>>>>>>>>>> We basically need an explicit 0.8.0-hadoop1
> >>>>> version
> >>>>>>>>> now.
> >>>>>>>>>>>>>>>>>>>>>>>>> The release candidate contains a 0.8.0
> >>> version
> >>>>>> which
> >>>>>>>>> has
> >>>>>>>>>>>>>>>>>> hadoop2
> >>>>>>>>>>>>>>>>>>>>>>>> activated
> >>>>>>>>>>>>>>>>>>>>>>>>> by default, the 0.8.0-hadoop2 version also
> >>> has
> >>>>>>> hadoop2
> >>>>>>>>>>>>>>>>>> activated
> >>>>>>>>>>>>>>>>>>>> by
> >>>>>>>>>>>>>>>>>>>>>>>>> default. In this release candidate, there
> >> is
> >>> no
> >>>>> way
> >>>>>>> for
> >>>>>>>>>>>>>>>>> users
> >>>>>>>>>>>>>>>>>> to
> >>>>>>>>>>>>>>>>>>>>>> depend
> >>>>>>>>>>>>>>>>>>>>>>>> on
> >>>>>>>>>>>>>>>>>>>>>>>>> a hadoop1 flink dependency.
> >>>>>>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>>>>> In general, we should warn users that the
> >>>> default
> >>>>>>>>> hadoop
> >>>>>>>>>>>>>>>>>>>>> dependencies
> >>>>>>>>>>>>>>>>>>>>>>>> have
> >>>>>>>>>>>>>>>>>>>>>>>>> changed with the release!
> >>>>>>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>>>>> I suggest to wait a bit with the next RC to
> >>>>> collect
> >>>>>>>>> more
> >>>>>>>>>>>>>>>>>>> feedback
> >>>>>>>>>>>>>>>>>>>> on
> >>>>>>>>>>>>>>>>>>>>>> the
> >>>>>>>>>>>>>>>>>>>>>>>>> release candidate.
> >>>>>>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>>>>> On Wed, Jan 7, 2015 at 7:37 PM, Márton
> >>> Balassi
> >>>> <
> >>>>>>>>>>>>>>>>>>>> mbalassi@apache.org
> >>>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>>>>> wrote:
> >>>>>>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>>>>>> Please vote on releasing the following
> >>>> candidate
> >>>>>> as
> >>>>>>>>>>>>>>>> Apache
> >>>>>>>>>>>>>>>>>>> Flink
> >>>>>>>>>>>>>>>>>>>>>>>> version
> >>>>>>>>>>>>>>>>>>>>>>>>>> 0.8.0
> >>>>>>>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>>>>>> This release will be the first major
> >> release
> >>>> for
> >>>>>>> Flink
> >>>>>>>>>>>>>>>> as a
> >>>>>>>>>>>>>>>>>> top
> >>>>>>>>>>>>>>>>>>>>> level
> >>>>>>>>>>>>>>>>>>>>>>>>>> project.
> >>>>>>>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>
> >>>>>> -------------------------------------------------------------
> >>>>>>>>>>>>>>>>>>>>>>>>>> The commit to be voted on is in the branch
> >>>>>>>>>>>>>>>>>> "release-0.8.0-rc1"
> >>>>>>>>>>>>>>>>>>>>>>>>>> (commit 8c30f60):
> >>>>>>>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>
> >>>>>> https://git-wip-us.apache.org/repos/asf/flink/commit/8c30f60
> >>>>>>>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>>>>>> The release artifacts to be voted on can
> >> be
> >>>>> found
> >>>>>>> at:
> >>>>>>>>>>>>>>>>>>>>>>>>>>
> >>>>>> http://people.apache.org/~mbalassi/flink-0.8.0-rc1/
> >>>>>>>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>>>>>> Release artifacts are signed with the
> >>>> following
> >>>>>> key:
> >>>>>>>>>>>>>>>>>>>>>>>>>>
> >>>>>>> https://people.apache.org/keys/committer/mbalassi.asc
> >>>>>>>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>>>>>> The staging repository for this release
> >> can
> >>> be
> >>>>>> found
> >>>>>>>>>>>>>>> at:
> >>>>>>>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>
> >>>>>>
> >>> https://repository.apache.org/content/repositories/orgapacheflink-1021
> >>>>>>>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>
> >>>>>> -------------------------------------------------------------
> >>>>>>>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>>>>>> Please vote on releasing this package as
> >>>> Apache
> >>>>>>> Flink
> >>>>>>>>>>>>>>>>> 0.8.0.
> >>>>>>>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>>>>>> The vote is open for the next 72 hours and
> >>>>> passes
> >>>>>>> if a
> >>>>>>>>>>>>>>>>>> majority
> >>>>>>>>>>>>>>>>>>>> of
> >>>>>>>>>>>>>>>>>>>>> at
> >>>>>>>>>>>>>>>>>>>>>>>>>> least
> >>>>>>>>>>>>>>>>>>>>>>>>>> three +1 PMC votes are cast.
> >>>>>>>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>>>>>> [ ] +1 Release this package as Apache
> >> Flink
> >>>>> 0.8.0
> >>>>>>>>>>>>>>>>>>>>>>>>>> [ ] -1 Do not release this package because
> >>> ...
> >>>>>>>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>
> >>>>>>>>
> >>>>>>>>
> >>>>>>>
> >>>>>>
> >>>>>
> >>>>
> >>>
> >>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message