Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 36816200D23 for ; Thu, 5 Oct 2017 02:13:23 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 34875160BD7; Thu, 5 Oct 2017 00:13:23 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 51C491609DD for ; Thu, 5 Oct 2017 02:13:22 +0200 (CEST) Received: (qmail 21430 invoked by uid 500); 5 Oct 2017 00:13:17 -0000 Mailing-List: contact yarn-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list yarn-dev@hadoop.apache.org Received: (qmail 21382 invoked by uid 99); 5 Oct 2017 00:13:17 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 05 Oct 2017 00:13:17 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 50C7818091D for ; Thu, 5 Oct 2017 00:13:16 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.88 X-Spam-Level: ** X-Spam-Status: No, score=2.88 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, KAM_NUMSUBJECT=0.5, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RCVD_IN_SORBS_SPAM=0.5, SPF_PASS=-0.001, WEIRD_PORT=0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=cloudera.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id GWzdSfQHjE75 for ; Thu, 5 Oct 2017 00:13:13 +0000 (UTC) Received: from mail-wm0-f48.google.com (mail-wm0-f48.google.com [74.125.82.48]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id 2F46E5FC8A for ; Thu, 5 Oct 2017 00:13:13 +0000 (UTC) Received: by mail-wm0-f48.google.com with SMTP id 196so11082541wma.1 for ; Wed, 04 Oct 2017 17:13:13 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cloudera.com; s=google; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=GUth0TLMd0WQiMPeDDjgWY9FWqzFT2exbKYmHuK+Gf8=; b=NbGy2vp8aLNCtD3U7Dzs/0bcARQzdx/BEsZESBqxsNCuSHe3LXmrW1Hz1ZPPje4hAY ZGZgc8A7VjgJcc57a9ll8i/7bRUs7AbKUYweZo9EQlwIlwxD+iqSI/NM/vAK114FcGTy sdOYPAFLzZthtQ3xq8R36p4rAxEfSFNHLAmFa5+sNNL2crVChArmWdWbkrp8+Gg6KlKG 4F+E2Fg7epmPXcsCOjRqReM3kzKvpaihxFYy0jw4v7j/DExUyBqsqDTyJQfa5TrdO/NT m6eaAE3ycjsU6YnZXL1BQ2Y37iuUd2tBheS4admrqKMlkXMVipZ7NfDW5R8XJuzXJXX1 xruw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=GUth0TLMd0WQiMPeDDjgWY9FWqzFT2exbKYmHuK+Gf8=; b=TOUq5nj+4Y+fIhnHfM2HuhR375oh4veGcJ4FbqwE66YhJ1tJs2uwKpsQVlvxNBJ81s pjp9Mqe6eJnA3eIRsBoJZ4VPV86ER3YdBuIQ7laFHyV2sMMNte4jGVkq4w/ap254NeRZ ad+02gKz9uKgMO4F8GzBomBdYYDBH363eyXe5W8O1i3hnbb+J4oNZ/Z4Bw/zzwRYJdgM TR4xZUOjyzlxf39Pb6PxMPocYBBDJeJ24G9qEhj/dPg0P4g+kQ6DgHbKJoyNfHAyQuUD s7sC28YsK6qCORVbWysBemgS8zOhArZn0xkLWZXrSwTq7uCTGJe0n0poD3vpjIXOTdKj OfmQ== X-Gm-Message-State: AHPjjUgmCP531CcFYfEZHHkTb6rFpXYyWo2fMsjEwe6HNw2neP9S3EdA MWo0Zbk1ScPAsKAcTbAFz5joLvBgbxKHjd4R6xu+kA== X-Google-Smtp-Source: AOwi7QBIE9iOKNZe0gkT9IeHehofBJmihfV25Ni2iEoDWApr1XNqjrprQuDDoJHUopJtvp7tzGBIjg7o/dyYG4B87MU= X-Received: by 10.80.160.231 with SMTP id 94mr30990508edo.242.1507162391992; Wed, 04 Oct 2017 17:13:11 -0700 (PDT) MIME-Version: 1.0 Received: by 10.80.240.196 with HTTP; Wed, 4 Oct 2017 17:12:51 -0700 (PDT) In-Reply-To: References: <511AAD1A-CD05-49CE-A597-7A647FA35E73@hortonworks.com> From: Andrew Wang Date: Wed, 4 Oct 2017 17:12:51 -0700 Message-ID: Subject: Re: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0 To: Rohith Sharma K S Cc: Aaron Fabbri , Ajay Kumar , Eric Badger , John Zhuge , Brahma Reddy Battula , "common-dev@hadoop.apache.org" , "hdfs-dev@hadoop.apache.org" , "mapreduce-dev@hadoop.apache.org" , "yarn-dev@hadoop.apache.org" Content-Type: multipart/alternative; boundary="94eb2c0d9920fe81c8055ac1964c" archived-at: Thu, 05 Oct 2017 00:13:23 -0000 --94eb2c0d9920fe81c8055ac1964c Content-Type: text/plain; charset="UTF-8" Thanks for the additional review Rohith, much appreciated! On Wed, Oct 4, 2017 at 12:14 AM, Rohith Sharma K S < rohithsharmaks@apache.org> wrote: > +1 (binding) > > Built from source and deployed YARN HA cluster with ATSv2 enabled in > non-secured cluster. > - tested for RM HA/work-preservring-restart/ NM-work-preserving restart > for ATSv2 entities. > - verified all ATSv2 REST end points to retrieve the entities > - ran sample MR jobs and distributed jobs > > Thanks & Regards > Rohith Sharma K S > > On 4 October 2017 at 05:31, Andrew Wang wrote: > >> Thanks everyone for voting! With 4 binding +1s and 7 non-binding +1s, the >> vote passes. >> >> I'll get started on pushing out the release. >> >> Best, >> Andrew >> >> On Tue, Oct 3, 2017 at 3:45 PM, Aaron Fabbri wrote: >> >> > +1 >> > >> > Built from source. Ran S3A integration tests in us-west-2 with S3Guard >> > (both Local and Dynamo metadatastore). >> > >> > Everything worked fine except I hit one integration test failure. It >> is a >> > minor test issue IMO and I've filed HADOOP-14927 >> > >> > Failed tests: >> > ITestS3GuardToolDynamoDB>AbstractS3GuardToolTestBase.testDe >> stroyNoBucket:228 >> > Expected an exception, got 0 >> > ITestS3GuardToolLocal>AbstractS3GuardToolTestBase.testDestr >> oyNoBucket:228 >> > Expected an exception, got 0 >> > >> > >> > >> > On Tue, Oct 3, 2017 at 2:45 PM, Ajay Kumar >> > wrote: >> > >> >> +1 (non-binding) >> >> >> >> - built from source >> >> - deployed on single node cluster >> >> - Basic hdfs operations >> >> - Run wordcount on a text file >> >> Thanks, >> >> Ajay >> >> >> >> >> >> On 10/3/17, 1:04 PM, "Eric Badger" wrote: >> >> >> >> +1 (non-binding) >> >> >> >> - Verified all checksums and signatures >> >> - Built native from source on macOS 10.12.6 and RHEL 7.1 >> >> - Deployed a single node pseudo cluster >> >> - Ran pi and sleep jobs >> >> - Verified Docker was marked as experimental >> >> >> >> Thanks, >> >> >> >> Eric >> >> >> >> On Tue, Oct 3, 2017 at 1:41 PM, John Zhuge >> >> wrote: >> >> >> >> > +1 (binding) >> >> > >> >> > - Verified checksums and signatures of all tarballs >> >> > - Built source with native, Java 1.8.0_131-b11 on Mac OS X >> >> 10.12.6 >> >> > - Verified cloud connectors: >> >> > - All S3A integration tests >> >> > - All ADL live unit tests >> >> > - Deployed both binary and built source to a pseudo cluster, >> >> passed the >> >> > following sanity tests in insecure, SSL, and SSL+Kerberos >> mode: >> >> > - HDFS basic and ACL >> >> > - DistCp basic >> >> > - MapReduce wordcount (only failed in SSL+Kerberos mode for >> >> binary >> >> > tarball, probably unrelated) >> >> > - KMS and HttpFS basic >> >> > - Balancer start/stop >> >> > >> >> > Hit the following errors but they don't seem to be blocking: >> >> > >> >> > == Missing dependencies during build == >> >> > >> >> > > ERROR: hadoop-aliyun has missing dependencies: >> json-lib-jdk15.jar >> >> > > ERROR: hadoop-azure has missing dependencies: >> >> jetty-util-ajax-9.3.19. >> >> > > v20170502.jar >> >> > > ERROR: hadoop-azure-datalake has missing dependencies: >> >> okhttp-2.4.0.jar >> >> > > ERROR: hadoop-azure-datalake has missing dependencies: >> >> okio-1.4.0.jar >> >> > >> >> > >> >> > Filed HADOOP-14923, HADOOP-14924, and HADOOP-14925. >> >> > >> >> > == Unit tests failed in Kerberos+SSL mode for KMS and HttpFs >> >> default HTTP >> >> > servlet /conf, /stacks, and /logLevel == >> >> > >> >> > One example below: >> >> > >> >> > > Connecting to >> >> > > https://localhost:14000/logLevel?log=org.apache.hadoop.fs. >> >> http.server. >> >> > HttpFSServer >> >> > > Exception in thread "main" >> >> > > org.apache.hadoop.security.authentication.client. >> >> > AuthenticationException: >> >> > > Authentication failed, URL: >> >> > > https://localhost:14000/logLevel?log=org.apache.hadoop.fs. >> >> http.server. >> >> > HttpFSServer&user.name=jzhuge, >> >> > > status: 403, message: GSSException: Failure unspecified at >> >> GSS-API level >> >> > > (Mechanism level: Request is a replay (34)) >> >> > >> >> > >> >> > The /logLevel failure will affect command "hadoop daemonlog". >> >> > >> >> > >> >> > On Tue, Oct 3, 2017 at 10:56 AM, Andrew Wang < >> >> andrew.wang@cloudera.com> >> >> > wrote: >> >> > >> >> > > Thanks for all the votes thus far! We've gotten the binding >> +1's >> >> to close >> >> > > the release, though are there contributors who could kick the >> >> tires on >> >> > > S3Guard and YARN TSv2 alpha2? These are the two new features >> >> merged since >> >> > > alpha4, so it'd be good to get some coverage. >> >> > > >> >> > > >> >> > > >> >> > > On Tue, Oct 3, 2017 at 9:45 AM, Brahma Reddy Battula < >> >> brahma@apache.org> >> >> > > wrote: >> >> > > >> >> > > > >> >> > > > Thanks Andrew. >> >> > > > >> >> > > > +1 (non binding) >> >> > > > >> >> > > > --Built from source >> >> > > > --installed 3 node HA cluster >> >> > > > --Verified shell commands and UI >> >> > > > --Ran wordcount/pic jobs >> >> > > > >> >> > > > >> >> > > > >> >> > > > >> >> > > > On Fri, 29 Sep 2017 at 5:34 AM, Andrew Wang < >> >> andrew.wang@cloudera.com> >> >> > > > wrote: >> >> > > > >> >> > > >> Hi all, >> >> > > >> >> >> > > >> Let me start, as always, by thanking the many, many >> >> contributors who >> >> > > >> helped >> >> > > >> with this release! I've prepared an RC0 for 3.0.0-beta1: >> >> > > >> >> >> > > >> http://home.apache.org/~wang/3.0.0-beta1-RC0/ >> >> > > >> >> >> > > >> This vote will run five days, ending on Nov 3rd at 5PM >> Pacific. >> >> > > >> >> >> > > >> beta1 contains 576 fixed JIRA issues comprising a number of >> >> bug fixes, >> >> > > >> improvements, and feature enhancements. Notable additions >> >> include the >> >> > > >> addition of YARN Timeline Service v2 alpha2, S3Guard, >> >> completion of >> >> > the >> >> > > >> shaded client, and HDFS erasure coding pluggable policy >> >> support. >> >> > > >> >> >> > > >> I've done the traditional testing of running a Pi job on a >> >> pseudo >> >> > > cluster. >> >> > > >> My +1 to start. >> >> > > >> >> >> > > >> We're working internally on getting this run through our >> >> integration >> >> > > test >> >> > > >> rig. I'm hoping Vijay or Ray can ring in with a +1 once >> that's >> >> > complete. >> >> > > >> >> >> > > >> Best, >> >> > > >> Andrew >> >> > > >> >> >> > > > -- >> >> > > > >> >> > > > >> >> > > > >> >> > > > --Brahma Reddy Battula >> >> > > > >> >> > > >> >> > >> >> > >> >> > >> >> > -- >> >> > John >> >> > >> >> >> >> >> >> >> > >> > > --94eb2c0d9920fe81c8055ac1964c--