hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Aaron Fabbri <fab...@cloudera.com>
Subject Re: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0
Date Tue, 03 Oct 2017 22:45:28 GMT
+1

Built from source.  Ran S3A integration tests in us-west-2 with S3Guard
(both Local and Dynamo metadatastore).

Everything worked fine except I hit one integration test failure.  It is a
minor test issue IMO and I've filed HADOOP-14927

Failed tests:

ITestS3GuardToolDynamoDB>AbstractS3GuardToolTestBase.testDestroyNoBucket:228
Expected an exception, got 0
  ITestS3GuardToolLocal>AbstractS3GuardToolTestBase.testDestroyNoBucket:228
Expected an exception, got 0



On Tue, Oct 3, 2017 at 2:45 PM, Ajay Kumar <ajay.kumar@hortonworks.com>
wrote:

> +1 (non-binding)
>
> - built from source
> - deployed on single node cluster
> - Basic hdfs operations
> - Run wordcount on a text file
> Thanks,
> Ajay
>
>
> On 10/3/17, 1:04 PM, "Eric Badger" <ebadger@oath.com.INVALID> wrote:
>
>     +1 (non-binding)
>
>     - Verified all checksums and signatures
>     - Built native from source on macOS 10.12.6 and RHEL 7.1
>     - Deployed a single node pseudo cluster
>     - Ran pi and sleep jobs
>     - Verified Docker was marked as experimental
>
>     Thanks,
>
>     Eric
>
>     On Tue, Oct 3, 2017 at 1:41 PM, John Zhuge <john.zhuge@gmail.com>
> wrote:
>
>     > +1 (binding)
>     >
>     >    - Verified checksums and signatures of all tarballs
>     >    - Built source with native, Java 1.8.0_131-b11 on Mac OS X 10.12.6
>     >    - Verified cloud connectors:
>     >       - All S3A integration tests
>     >       - All ADL live unit tests
>     >    - Deployed both binary and built source to a pseudo cluster,
> passed the
>     >    following sanity tests in insecure, SSL, and SSL+Kerberos mode:
>     >       - HDFS basic and ACL
>     >       - DistCp basic
>     >       - MapReduce wordcount (only failed in SSL+Kerberos mode for
> binary
>     >       tarball, probably unrelated)
>     >       - KMS and HttpFS basic
>     >       - Balancer start/stop
>     >
>     > Hit the following errors but they don't seem to be blocking:
>     >
>     > == Missing dependencies during build ==
>     >
>     > > ERROR: hadoop-aliyun has missing dependencies: json-lib-jdk15.jar
>     > > ERROR: hadoop-azure has missing dependencies:
> jetty-util-ajax-9.3.19.
>     > > v20170502.jar
>     > > ERROR: hadoop-azure-datalake has missing dependencies:
> okhttp-2.4.0.jar
>     > > ERROR: hadoop-azure-datalake has missing dependencies:
> okio-1.4.0.jar
>     >
>     >
>     > Filed HADOOP-14923, HADOOP-14924, and HADOOP-14925.
>     >
>     > == Unit tests failed in Kerberos+SSL mode for KMS and HttpFs default
> HTTP
>     > servlet /conf, /stacks, and /logLevel ==
>     >
>     > One example below:
>     >
>     > >    Connecting to
>     > > https://localhost:14000/logLevel?log=org.apache.
> hadoop.fs.http.server.
>     > HttpFSServer
>     > >    Exception in thread "main"
>     > > org.apache.hadoop.security.authentication.client.
>     > AuthenticationException:
>     > > Authentication failed, URL:
>     > > https://localhost:14000/logLevel?log=org.apache.
> hadoop.fs.http.server.
>     > HttpFSServer&user.name=jzhuge,
>     > > status: 403, message: GSSException: Failure unspecified at GSS-API
> level
>     > > (Mechanism level: Request is a replay (34))
>     >
>     >
>     > The /logLevel failure will affect command "hadoop daemonlog".
>     >
>     >
>     > On Tue, Oct 3, 2017 at 10:56 AM, Andrew Wang <
> andrew.wang@cloudera.com>
>     > wrote:
>     >
>     > > Thanks for all the votes thus far! We've gotten the binding +1's
> to close
>     > > the release, though are there contributors who could kick the
> tires on
>     > > S3Guard and YARN TSv2 alpha2? These are the two new features
> merged since
>     > > alpha4, so it'd be good to get some coverage.
>     > >
>     > >
>     > >
>     > > On Tue, Oct 3, 2017 at 9:45 AM, Brahma Reddy Battula <
> brahma@apache.org>
>     > > wrote:
>     > >
>     > > >
>     > > > Thanks Andrew.
>     > > >
>     > > > +1 (non binding)
>     > > >
>     > > > --Built from source
>     > > > --installed 3 node HA cluster
>     > > > --Verified shell commands and UI
>     > > > --Ran wordcount/pic jobs
>     > > >
>     > > >
>     > > >
>     > > >
>     > > > On Fri, 29 Sep 2017 at 5:34 AM, Andrew Wang <
> andrew.wang@cloudera.com>
>     > > > wrote:
>     > > >
>     > > >> Hi all,
>     > > >>
>     > > >> Let me start, as always, by thanking the many, many
> contributors who
>     > > >> helped
>     > > >> with this release! I've prepared an RC0 for 3.0.0-beta1:
>     > > >>
>     > > >> http://home.apache.org/~wang/3.0.0-beta1-RC0/
>     > > >>
>     > > >> This vote will run five days, ending on Nov 3rd at 5PM Pacific.
>     > > >>
>     > > >> beta1 contains 576 fixed JIRA issues comprising a number of bug
> fixes,
>     > > >> improvements, and feature enhancements. Notable additions
> include the
>     > > >> addition of YARN Timeline Service v2 alpha2, S3Guard,
> completion of
>     > the
>     > > >> shaded client, and HDFS erasure coding pluggable policy support.
>     > > >>
>     > > >> I've done the traditional testing of running a Pi job on a
> pseudo
>     > > cluster.
>     > > >> My +1 to start.
>     > > >>
>     > > >> We're working internally on getting this run through our
> integration
>     > > test
>     > > >> rig. I'm hoping Vijay or Ray can ring in with a +1 once that's
>     > complete.
>     > > >>
>     > > >> Best,
>     > > >> Andrew
>     > > >>
>     > > > --
>     > > >
>     > > >
>     > > >
>     > > > --Brahma Reddy Battula
>     > > >
>     > >
>     >
>     >
>     >
>     > --
>     > John
>     >
>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message