From hdfs-dev-return-32118-archive-asf-public=cust-asf.ponee.io@hadoop.apache.org Mon Apr 2 23:39:49 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id 8E770180675 for ; Mon, 2 Apr 2018 23:39:48 +0200 (CEST) Received: (qmail 15552 invoked by uid 500); 2 Apr 2018 21:39:46 -0000 Mailing-List: contact hdfs-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list hdfs-dev@hadoop.apache.org Received: (qmail 15493 invoked by uid 99); 2 Apr 2018 21:39:45 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 02 Apr 2018 21:39:45 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 42BD118048D; Mon, 2 Apr 2018 21:39:45 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.129 X-Spam-Level: ** X-Spam-Status: No, score=2.129 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, KAM_LOTSOFHASH=0.25, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id sCbXQYGF6Qox; Mon, 2 Apr 2018 21:39:43 +0000 (UTC) Received: from mail-wm0-f45.google.com (mail-wm0-f45.google.com [74.125.82.45]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id 5A0E55F1F0; Mon, 2 Apr 2018 21:39:43 +0000 (UTC) Received: by mail-wm0-f45.google.com with SMTP id p9so28514664wmc.3; Mon, 02 Apr 2018 14:39:43 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=t3c7Txe6wudZ2dZiEGeXw17jX/b0GKhysHHdaqeD7wI=; b=czLCL9C2ScJ93pyyykHFVlz1cm8BOuz75BgXh0+7bZhtrEy4cE27YflE0Iy92CLh5C 5weKbSt+T4+b23mRXVpCo8ZyqdALFO6V0vEFkSwGSU+XX/Fd5IfpN9GL7Hcy+5tnn+FZ hKJXu8m0gkmu36bjM6/E0QCa6/TleYIZOqOjIrpiIaFvfswhJ93MNczrkeOrIMYSsFbR ityNr2A8LMDxZcRDEm1Ico9QNkKUWGVFxxvaBi9OgtWp7UWsDxxyWgK3zKoR/i5H199+ DtobtXnpf4Ytq779sEdsXrynZ1IifWqgz9lh/g6RwbIrEB1u/JBKvq5+KSI3om0r9oHh JzOg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=t3c7Txe6wudZ2dZiEGeXw17jX/b0GKhysHHdaqeD7wI=; b=VwFyXiadz/2K444FX6IbjIFMlyTpdZ4m01L3nJmqPYUCyVSnIKa5sHH+KpfPXY/pYW AInrZu6eBxHAqa8TYGlRum2cVK5eNapgM4UwoJJgcaTi5x0fI3pimM4Fk9p0HtJ7sSqw EJNJL6YaHrcyimdWPjYVy2CopG8nnrHlaR6PQz8+un9UfTD1ReWfNzqlbtq3aTgofb4f rSdN3JJ9rgRxF95ML7BuGllJL/9DB3g2qketHy7plcW+GeDW7M6l9gOdG3xxDDKo8kyx B+5kTcsXC8BqrdKxtYjd/0fFqRJHkf5rEq69ZOXl2KJ7AzWTzd3Q+r18z5Usor20T/Fe wEpA== X-Gm-Message-State: AElRT7FCmFoRxEwkxmSGd11HuzFyfUeD1rnqsWtXnN9dTNp4NQakEpgz 8VUIaUstoEwe9WN+SCSQr6FjLlSqxCdzoLXgizY= X-Google-Smtp-Source: AIpwx4+lbpCtQOuPkPRWRbuqDbIm/beDGZlC9/Gxa/T0uNuczPcYI/Vz4xLtW0ss8k3D+TTT0DglC3nhxmcHkQ0VOPI= X-Received: by 10.80.151.221 with SMTP id f29mr14061908edb.57.1522705182148; Mon, 02 Apr 2018 14:39:42 -0700 (PDT) MIME-Version: 1.0 Received: by 10.80.134.250 with HTTP; Mon, 2 Apr 2018 14:39:11 -0700 (PDT) In-Reply-To: <90C798EB-A475-4AFD-A194-5C5773107F47@hortonworks.com> References: <90C798EB-A475-4AFD-A194-5C5773107F47@hortonworks.com> From: Wangda Tan Date: Mon, 2 Apr 2018 14:39:11 -0700 Message-ID: Subject: Re: [VOTE] Release Apache Hadoop 3.1.0 (RC1) To: Arpit Agarwal Cc: Gera Shegalov , Sunil G , "yarn-dev@hadoop.apache.org" , Hdfs-dev , Hadoop Common , "mapreduce-dev@hadoop.apache.org" , Vinod Kumar Vavilapalli Content-Type: multipart/alternative; boundary="f403045c50e07acc770568e46d59" --f403045c50e07acc770568e46d59 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hi Arpit, Thanks for pointing out this. I just removed all .md5 files from artifacts. I found md5 checksums still exist in .mds files and I didn't remove them from .mds file because it is generated by create-release script and Apache guidance is "should not" instead of "must not". Please let me know if you think they need to be removed as well. - Wangda On Mon, Apr 2, 2018 at 1:37 PM, Arpit Agarwal wrote: > Thanks for putting together this RC, Wangda. > > The guidance from Apache is to omit MD5s, specifically: > > SHOULD NOT supply a MD5 checksum file (because MD5 is too broken). > > https://www.apache.org/dev/release-distribution#sigs-and-sums > > > > On Apr 2, 2018, at 7:03 AM, Wangda Tan wrote: > > Hi Gera, > > It's my bad, I thought only src/bin tarball is enough. > > I just uploaded all other things under artifact/ to > http://people.apache.org/~wangda/hadoop-3.1.0-RC1/ > > Please let me know if you have any other comments. > > Thanks, > Wangda > > > On Mon, Apr 2, 2018 at 12:50 AM, Gera Shegalov wrote: > > Thanks, Wangda! > > There are many more artifacts in previous votes, e.g., see > http://home.apache.org/~junping_du/hadoop-2.8.3-RC0/ . Among others the > site tarball is missing. > > On Sun, Apr 1, 2018 at 11:54 PM Sunil G wrote: > > Thanks Wangda for initiating the release. > > I tested this RC built from source file. > > > - Tested MR apps (sleep, wc) and verified both new YARN UI and old RM > UI. > - Below feature sanity is done > - Application priority > - Application timeout > - Intra Queue preemption with priority based > - DS based affinity tests to verify placement constraints. > - Tested basic NodeLabel scenarios. > - Added couple of labels to few of nodes and behavior is coming > correct. > - Verified old UI and new YARN UI for labels. > - Submitted apps to labelled cluster and it works fine. > - Also performed few cli commands related to nodelabel. > - Test basic HA cases and seems correct. > - Tested new YARN UI . All pages are getting loaded correctly. > > > - Sunil > > On Fri, Mar 30, 2018 at 9:45 AM Wangda Tan wrote: > > Hi folks, > > Thanks to the many who helped with this release since Dec 2017 [1]. > > We've > > created RC1 for Apache Hadoop 3.1.0. The artifacts are available here: > > http://people.apache.org/~wangda/hadoop-3.1.0-RC1 > > The RC tag in git is release-3.1.0-RC1. Last git commit SHA is > 16b70619a24cdcf5d3b0fcf4b58ca77238ccbe6d > > The maven artifacts are available via repository.apache.org at > https://repository.apache.org/content/repositories/ > > orgapachehadoop-1090/ > > This vote will run 5 days, ending on Apr 3 at 11:59 pm Pacific. > > 3.1.0 contains 766 [2] fixed JIRA issues since 3.0.0. Notable additions > include the first class GPU/FPGA support on YARN, Native services, > > Support > > rich placement constraints in YARN, S3-related enhancements, allow HDFS > block replicas to be provided by an external storage system, etc. > > For 3.1.0 RC0 vote discussion, please see [3]. > > We=E2=80=99d like to use this as a starting release for 3.1.x [1], depend= ing on > > how > > it goes, get it stabilized and potentially use a 3.1.1 in several weeks > > as > > the stable release. > > We have done testing with a pseudo cluster: > - Ran distributed job. > - GPU scheduling/isolation. > - Placement constraints (intra-application anti-affinity) by using > distributed shell. > > My +1 to start. > > Best, > Wangda/Vinod > > [1] > > https://lists.apache.org/thread.html/b3fb3b6da8b6357a68513a6dfd104b > > c9e19e559aedc5ebedb4ca08c8@%3Cyarn-dev.hadoop.apache.org%3E > > [2] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.1.0) > AND fixVersion not in (3.0.0, 3.0.0-beta1) AND status =3D Resolved ORDER > > BY > > fixVersion ASC > [3] > > https://lists.apache.org/thread.html/b3a7dc075b7329fd660f65b48237d7 > > 2d4061f26f83547e41d0983ea6@%3Cyarn-dev.hadoop.apache.org%3E > > > > > > --f403045c50e07acc770568e46d59--