hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Rohith Sharma K S <rohithsharm...@apache.org>
Subject Re: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0
Date Wed, 04 Oct 2017 07:14:00 GMT
+1 (binding)

Built from source and deployed YARN HA cluster with ATSv2 enabled in
non-secured cluster.
- tested for RM HA/work-preservring-restart/ NM-work-preserving restart for
ATSv2 entities.
- verified all ATSv2 REST end points to retrieve the entities
- ran sample MR jobs and distributed jobs

Thanks & Regards
Rohith Sharma K S

On 4 October 2017 at 05:31, Andrew Wang <andrew.wang@cloudera.com> wrote:

> Thanks everyone for voting! With 4 binding +1s and 7 non-binding +1s, the
> vote passes.
>
> I'll get started on pushing out the release.
>
> Best,
> Andrew
>
> On Tue, Oct 3, 2017 at 3:45 PM, Aaron Fabbri <fabbri@cloudera.com> wrote:
>
> > +1
> >
> > Built from source.  Ran S3A integration tests in us-west-2 with S3Guard
> > (both Local and Dynamo metadatastore).
> >
> > Everything worked fine except I hit one integration test failure.  It is
> a
> > minor test issue IMO and I've filed HADOOP-14927
> >
> > Failed tests:
> >   ITestS3GuardToolDynamoDB>AbstractS3GuardToolTestBase.
> testDestroyNoBucket:228
> > Expected an exception, got 0
> >   ITestS3GuardToolLocal>AbstractS3GuardToolTestBase.
> testDestroyNoBucket:228
> > Expected an exception, got 0
> >
> >
> >
> > On Tue, Oct 3, 2017 at 2:45 PM, Ajay Kumar <ajay.kumar@hortonworks.com>
> > wrote:
> >
> >> +1 (non-binding)
> >>
> >> - built from source
> >> - deployed on single node cluster
> >> - Basic hdfs operations
> >> - Run wordcount on a text file
> >> Thanks,
> >> Ajay
> >>
> >>
> >> On 10/3/17, 1:04 PM, "Eric Badger" <ebadger@oath.com.INVALID> wrote:
> >>
> >>     +1 (non-binding)
> >>
> >>     - Verified all checksums and signatures
> >>     - Built native from source on macOS 10.12.6 and RHEL 7.1
> >>     - Deployed a single node pseudo cluster
> >>     - Ran pi and sleep jobs
> >>     - Verified Docker was marked as experimental
> >>
> >>     Thanks,
> >>
> >>     Eric
> >>
> >>     On Tue, Oct 3, 2017 at 1:41 PM, John Zhuge <john.zhuge@gmail.com>
> >> wrote:
> >>
> >>     > +1 (binding)
> >>     >
> >>     >    - Verified checksums and signatures of all tarballs
> >>     >    - Built source with native, Java 1.8.0_131-b11 on Mac OS X
> >> 10.12.6
> >>     >    - Verified cloud connectors:
> >>     >       - All S3A integration tests
> >>     >       - All ADL live unit tests
> >>     >    - Deployed both binary and built source to a pseudo cluster,
> >> passed the
> >>     >    following sanity tests in insecure, SSL, and SSL+Kerberos mode:
> >>     >       - HDFS basic and ACL
> >>     >       - DistCp basic
> >>     >       - MapReduce wordcount (only failed in SSL+Kerberos mode for
> >> binary
> >>     >       tarball, probably unrelated)
> >>     >       - KMS and HttpFS basic
> >>     >       - Balancer start/stop
> >>     >
> >>     > Hit the following errors but they don't seem to be blocking:
> >>     >
> >>     > == Missing dependencies during build ==
> >>     >
> >>     > > ERROR: hadoop-aliyun has missing dependencies:
> json-lib-jdk15.jar
> >>     > > ERROR: hadoop-azure has missing dependencies:
> >> jetty-util-ajax-9.3.19.
> >>     > > v20170502.jar
> >>     > > ERROR: hadoop-azure-datalake has missing dependencies:
> >> okhttp-2.4.0.jar
> >>     > > ERROR: hadoop-azure-datalake has missing dependencies:
> >> okio-1.4.0.jar
> >>     >
> >>     >
> >>     > Filed HADOOP-14923, HADOOP-14924, and HADOOP-14925.
> >>     >
> >>     > == Unit tests failed in Kerberos+SSL mode for KMS and HttpFs
> >> default HTTP
> >>     > servlet /conf, /stacks, and /logLevel ==
> >>     >
> >>     > One example below:
> >>     >
> >>     > >    Connecting to
> >>     > > https://localhost:14000/logLevel?log=org.apache.hadoop.fs.
> >> http.server.
> >>     > HttpFSServer
> >>     > >    Exception in thread "main"
> >>     > > org.apache.hadoop.security.authentication.client.
> >>     > AuthenticationException:
> >>     > > Authentication failed, URL:
> >>     > > https://localhost:14000/logLevel?log=org.apache.hadoop.fs.
> >> http.server.
> >>     > HttpFSServer&user.name=jzhuge,
> >>     > > status: 403, message: GSSException: Failure unspecified at
> >> GSS-API level
> >>     > > (Mechanism level: Request is a replay (34))
> >>     >
> >>     >
> >>     > The /logLevel failure will affect command "hadoop daemonlog".
> >>     >
> >>     >
> >>     > On Tue, Oct 3, 2017 at 10:56 AM, Andrew Wang <
> >> andrew.wang@cloudera.com>
> >>     > wrote:
> >>     >
> >>     > > Thanks for all the votes thus far! We've gotten the binding +1's
> >> to close
> >>     > > the release, though are there contributors who could kick the
> >> tires on
> >>     > > S3Guard and YARN TSv2 alpha2? These are the two new features
> >> merged since
> >>     > > alpha4, so it'd be good to get some coverage.
> >>     > >
> >>     > >
> >>     > >
> >>     > > On Tue, Oct 3, 2017 at 9:45 AM, Brahma Reddy Battula <
> >> brahma@apache.org>
> >>     > > wrote:
> >>     > >
> >>     > > >
> >>     > > > Thanks Andrew.
> >>     > > >
> >>     > > > +1 (non binding)
> >>     > > >
> >>     > > > --Built from source
> >>     > > > --installed 3 node HA cluster
> >>     > > > --Verified shell commands and UI
> >>     > > > --Ran wordcount/pic jobs
> >>     > > >
> >>     > > >
> >>     > > >
> >>     > > >
> >>     > > > On Fri, 29 Sep 2017 at 5:34 AM, Andrew Wang <
> >> andrew.wang@cloudera.com>
> >>     > > > wrote:
> >>     > > >
> >>     > > >> Hi all,
> >>     > > >>
> >>     > > >> Let me start, as always, by thanking the many, many
> >> contributors who
> >>     > > >> helped
> >>     > > >> with this release! I've prepared an RC0 for 3.0.0-beta1:
> >>     > > >>
> >>     > > >> http://home.apache.org/~wang/3.0.0-beta1-RC0/
> >>     > > >>
> >>     > > >> This vote will run five days, ending on Nov 3rd at 5PM
> Pacific.
> >>     > > >>
> >>     > > >> beta1 contains 576 fixed JIRA issues comprising a number
of
> >> bug fixes,
> >>     > > >> improvements, and feature enhancements. Notable additions
> >> include the
> >>     > > >> addition of YARN Timeline Service v2 alpha2, S3Guard,
> >> completion of
> >>     > the
> >>     > > >> shaded client, and HDFS erasure coding pluggable policy
> >> support.
> >>     > > >>
> >>     > > >> I've done the traditional testing of running a Pi job
on a
> >> pseudo
> >>     > > cluster.
> >>     > > >> My +1 to start.
> >>     > > >>
> >>     > > >> We're working internally on getting this run through
our
> >> integration
> >>     > > test
> >>     > > >> rig. I'm hoping Vijay or Ray can ring in with a +1 once
> that's
> >>     > complete.
> >>     > > >>
> >>     > > >> Best,
> >>     > > >> Andrew
> >>     > > >>
> >>     > > > --
> >>     > > >
> >>     > > >
> >>     > > >
> >>     > > > --Brahma Reddy Battula
> >>     > > >
> >>     > >
> >>     >
> >>     >
> >>     >
> >>     > --
> >>     > John
> >>     >
> >>
> >>
> >>
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message