hadoop-yarn-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andrew Wang <andrew.w...@cloudera.com>
Subject Re: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0
Date Thu, 05 Oct 2017 00:12:51 GMT
Thanks for the additional review Rohith, much appreciated!

On Wed, Oct 4, 2017 at 12:14 AM, Rohith Sharma K S <
rohithsharmaks@apache.org> wrote:

> +1 (binding)
>
> Built from source and deployed YARN HA cluster with ATSv2 enabled in
> non-secured cluster.
> - tested for RM HA/work-preservring-restart/ NM-work-preserving restart
> for ATSv2 entities.
> - verified all ATSv2 REST end points to retrieve the entities
> - ran sample MR jobs and distributed jobs
>
> Thanks & Regards
> Rohith Sharma K S
>
> On 4 October 2017 at 05:31, Andrew Wang <andrew.wang@cloudera.com> wrote:
>
>> Thanks everyone for voting! With 4 binding +1s and 7 non-binding +1s, the
>> vote passes.
>>
>> I'll get started on pushing out the release.
>>
>> Best,
>> Andrew
>>
>> On Tue, Oct 3, 2017 at 3:45 PM, Aaron Fabbri <fabbri@cloudera.com> wrote:
>>
>> > +1
>> >
>> > Built from source.  Ran S3A integration tests in us-west-2 with S3Guard
>> > (both Local and Dynamo metadatastore).
>> >
>> > Everything worked fine except I hit one integration test failure.  It
>> is a
>> > minor test issue IMO and I've filed HADOOP-14927
>> >
>> > Failed tests:
>> >   ITestS3GuardToolDynamoDB>AbstractS3GuardToolTestBase.testDe
>> stroyNoBucket:228
>> > Expected an exception, got 0
>> >   ITestS3GuardToolLocal>AbstractS3GuardToolTestBase.testDestr
>> oyNoBucket:228
>> > Expected an exception, got 0
>> >
>> >
>> >
>> > On Tue, Oct 3, 2017 at 2:45 PM, Ajay Kumar <ajay.kumar@hortonworks.com>
>> > wrote:
>> >
>> >> +1 (non-binding)
>> >>
>> >> - built from source
>> >> - deployed on single node cluster
>> >> - Basic hdfs operations
>> >> - Run wordcount on a text file
>> >> Thanks,
>> >> Ajay
>> >>
>> >>
>> >> On 10/3/17, 1:04 PM, "Eric Badger" <ebadger@oath.com.INVALID> wrote:
>> >>
>> >>     +1 (non-binding)
>> >>
>> >>     - Verified all checksums and signatures
>> >>     - Built native from source on macOS 10.12.6 and RHEL 7.1
>> >>     - Deployed a single node pseudo cluster
>> >>     - Ran pi and sleep jobs
>> >>     - Verified Docker was marked as experimental
>> >>
>> >>     Thanks,
>> >>
>> >>     Eric
>> >>
>> >>     On Tue, Oct 3, 2017 at 1:41 PM, John Zhuge <john.zhuge@gmail.com>
>> >> wrote:
>> >>
>> >>     > +1 (binding)
>> >>     >
>> >>     >    - Verified checksums and signatures of all tarballs
>> >>     >    - Built source with native, Java 1.8.0_131-b11 on Mac OS X
>> >> 10.12.6
>> >>     >    - Verified cloud connectors:
>> >>     >       - All S3A integration tests
>> >>     >       - All ADL live unit tests
>> >>     >    - Deployed both binary and built source to a pseudo cluster,
>> >> passed the
>> >>     >    following sanity tests in insecure, SSL, and SSL+Kerberos
>> mode:
>> >>     >       - HDFS basic and ACL
>> >>     >       - DistCp basic
>> >>     >       - MapReduce wordcount (only failed in SSL+Kerberos mode for
>> >> binary
>> >>     >       tarball, probably unrelated)
>> >>     >       - KMS and HttpFS basic
>> >>     >       - Balancer start/stop
>> >>     >
>> >>     > Hit the following errors but they don't seem to be blocking:
>> >>     >
>> >>     > == Missing dependencies during build ==
>> >>     >
>> >>     > > ERROR: hadoop-aliyun has missing dependencies:
>> json-lib-jdk15.jar
>> >>     > > ERROR: hadoop-azure has missing dependencies:
>> >> jetty-util-ajax-9.3.19.
>> >>     > > v20170502.jar
>> >>     > > ERROR: hadoop-azure-datalake has missing dependencies:
>> >> okhttp-2.4.0.jar
>> >>     > > ERROR: hadoop-azure-datalake has missing dependencies:
>> >> okio-1.4.0.jar
>> >>     >
>> >>     >
>> >>     > Filed HADOOP-14923, HADOOP-14924, and HADOOP-14925.
>> >>     >
>> >>     > == Unit tests failed in Kerberos+SSL mode for KMS and HttpFs
>> >> default HTTP
>> >>     > servlet /conf, /stacks, and /logLevel ==
>> >>     >
>> >>     > One example below:
>> >>     >
>> >>     > >    Connecting to
>> >>     > > https://localhost:14000/logLevel?log=org.apache.hadoop.fs.
>> >> http.server.
>> >>     > HttpFSServer
>> >>     > >    Exception in thread "main"
>> >>     > > org.apache.hadoop.security.authentication.client.
>> >>     > AuthenticationException:
>> >>     > > Authentication failed, URL:
>> >>     > > https://localhost:14000/logLevel?log=org.apache.hadoop.fs.
>> >> http.server.
>> >>     > HttpFSServer&user.name=jzhuge,
>> >>     > > status: 403, message: GSSException: Failure unspecified at
>> >> GSS-API level
>> >>     > > (Mechanism level: Request is a replay (34))
>> >>     >
>> >>     >
>> >>     > The /logLevel failure will affect command "hadoop daemonlog".
>> >>     >
>> >>     >
>> >>     > On Tue, Oct 3, 2017 at 10:56 AM, Andrew Wang <
>> >> andrew.wang@cloudera.com>
>> >>     > wrote:
>> >>     >
>> >>     > > Thanks for all the votes thus far! We've gotten the binding
>> +1's
>> >> to close
>> >>     > > the release, though are there contributors who could kick
the
>> >> tires on
>> >>     > > S3Guard and YARN TSv2 alpha2? These are the two new features
>> >> merged since
>> >>     > > alpha4, so it'd be good to get some coverage.
>> >>     > >
>> >>     > >
>> >>     > >
>> >>     > > On Tue, Oct 3, 2017 at 9:45 AM, Brahma Reddy Battula <
>> >> brahma@apache.org>
>> >>     > > wrote:
>> >>     > >
>> >>     > > >
>> >>     > > > Thanks Andrew.
>> >>     > > >
>> >>     > > > +1 (non binding)
>> >>     > > >
>> >>     > > > --Built from source
>> >>     > > > --installed 3 node HA cluster
>> >>     > > > --Verified shell commands and UI
>> >>     > > > --Ran wordcount/pic jobs
>> >>     > > >
>> >>     > > >
>> >>     > > >
>> >>     > > >
>> >>     > > > On Fri, 29 Sep 2017 at 5:34 AM, Andrew Wang <
>> >> andrew.wang@cloudera.com>
>> >>     > > > wrote:
>> >>     > > >
>> >>     > > >> Hi all,
>> >>     > > >>
>> >>     > > >> Let me start, as always, by thanking the many, many
>> >> contributors who
>> >>     > > >> helped
>> >>     > > >> with this release! I've prepared an RC0 for 3.0.0-beta1:
>> >>     > > >>
>> >>     > > >> http://home.apache.org/~wang/3.0.0-beta1-RC0/
>> >>     > > >>
>> >>     > > >> This vote will run five days, ending on Nov 3rd at
5PM
>> Pacific.
>> >>     > > >>
>> >>     > > >> beta1 contains 576 fixed JIRA issues comprising a
number of
>> >> bug fixes,
>> >>     > > >> improvements, and feature enhancements. Notable additions
>> >> include the
>> >>     > > >> addition of YARN Timeline Service v2 alpha2, S3Guard,
>> >> completion of
>> >>     > the
>> >>     > > >> shaded client, and HDFS erasure coding pluggable
policy
>> >> support.
>> >>     > > >>
>> >>     > > >> I've done the traditional testing of running a Pi
job on a
>> >> pseudo
>> >>     > > cluster.
>> >>     > > >> My +1 to start.
>> >>     > > >>
>> >>     > > >> We're working internally on getting this run through
our
>> >> integration
>> >>     > > test
>> >>     > > >> rig. I'm hoping Vijay or Ray can ring in with a +1
once
>> that's
>> >>     > complete.
>> >>     > > >>
>> >>     > > >> Best,
>> >>     > > >> Andrew
>> >>     > > >>
>> >>     > > > --
>> >>     > > >
>> >>     > > >
>> >>     > > >
>> >>     > > > --Brahma Reddy Battula
>> >>     > > >
>> >>     > >
>> >>     >
>> >>     >
>> >>     >
>> >>     > --
>> >>     > John
>> >>     >
>> >>
>> >>
>> >>
>> >
>>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message