Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 2ACEC200CFD for ; Wed, 6 Sep 2017 20:14:48 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 294FE1609C5; Wed, 6 Sep 2017 18:14:48 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 7000D1609BB for ; Wed, 6 Sep 2017 20:14:47 +0200 (CEST) Received: (qmail 61515 invoked by uid 500); 6 Sep 2017 18:14:42 -0000 Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list common-dev@hadoop.apache.org Received: (qmail 61467 invoked by uid 99); 6 Sep 2017 18:14:42 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 06 Sep 2017 18:14:42 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 23CB7183537; Wed, 6 Sep 2017 18:14:42 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.879 X-Spam-Level: * X-Spam-Status: No, score=1.879 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id 9OfYA0baxvfi; Wed, 6 Sep 2017 18:14:37 +0000 (UTC) Received: from mail-wm0-f41.google.com (mail-wm0-f41.google.com [74.125.82.41]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id 8A78F5F6BE; Wed, 6 Sep 2017 18:14:31 +0000 (UTC) Received: by mail-wm0-f41.google.com with SMTP id u26so34065643wma.0; Wed, 06 Sep 2017 11:14:31 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=XIVgaZoJIN0kgA9uYWa98sab99kVEWXIaPaLBJlPH7o=; b=J9fkDs315WmKLBNaCVDv+kdjfNy+fm5z1bUimYBbnk7XGU33WJipOzi/8B9L4Kvfd9 TAgBKrPrgda3sKSSMPmFKRURHOzMcT0cjTtEWLy4mBxGIxwQKacbVVRIKX+a8JWN649u HYRzrSiTdoLPWiMEahpiLTiLNUMSI1mtP6At1kgNtWXYvR4IsAQVpMHOzVq6TvzE5hqR jHNqK3MFpyvC+3/jQf//x2G4L3pu/eFzxMrKwo1HteovEyhaXCa35V4yDLA8bfnSB/7t YtBm2IbtxVcYrMRfm2grMeg//kfnPUB1wn+Vqz0hd6k0KHm460J0K5/xxUm8mOobdpe1 +fUQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=XIVgaZoJIN0kgA9uYWa98sab99kVEWXIaPaLBJlPH7o=; b=rII4sjqW8Pi7dLp8YqTbYnb+BdVvbxJmwVqwUXFJTTFDL4MvlBwCepi+kUb0uKFT/N 7kl2UwKbR5h6SHbvNCaMNecnZf6OqF/gcezJ+mRvBaJZoTyYVFqGUHluPvHGO0LDI0Q9 xK9QCduT4IAh92fAlq3l7pGrvdjaP/DZJjcDuTFd4PUdyN0FyDUMHjmj5Bk3nyRuQ6vb 8i7cq5LxD2f6+K9Rp7SUxsWRDvG+rglrZWdyHNCGk0QtGqQsl3HFF6nmsVB+BFchyIAX 5Az7+JvYkx3q632jHmn66m0TgB9TZ49nqoc+YOkeRVBwMjY6X1dqCrtUWz7cbOsHYy9F hG1Q== X-Gm-Message-State: AHPjjUinM69nBObrphlwN+dosIY7j037O6ERms5fgD6cm3ng2DTdIe14 ShWVgSGKXKewxhJIjbgANbNJPhpW10bF X-Google-Smtp-Source: ADKCNb5TQgO610K7ak1wpGuKB7755v8RbFF5uFgsODPpJcxQJXAG/inkvUiAzpJGYp3U8I0pcKsaTGlTcGtJ26jFv+w= X-Received: by 10.80.168.99 with SMTP id j90mr504348edc.10.1504721669925; Wed, 06 Sep 2017 11:14:29 -0700 (PDT) MIME-Version: 1.0 Received: by 10.80.162.103 with HTTP; Wed, 6 Sep 2017 11:13:59 -0700 (PDT) From: Wangda Tan Date: Wed, 6 Sep 2017 11:13:59 -0700 Message-ID: Subject: [DISCUSS] Looking to Apache Hadoop 3.1 release To: "yarn-dev@hadoop.apache.org" , "mapreduce-dev@hadoop.apache.org" , "hdfs-dev@hadoop.apache.org" , "common-dev@hadoop.apache.org" Content-Type: multipart/alternative; boundary="f403045c2dc09f334305588950fd" archived-at: Wed, 06 Sep 2017 18:14:48 -0000 --f403045c2dc09f334305588950fd Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hi all, As we discussed on [1], there were proposals from Steve / Vinod etc to have a faster cadence of releases and to start thinking of a Hadoop 3.1 release earlier than March 2018 as is currently proposed. I think this is a good idea. I'd like to start the process sooner, and establish timeline etc so that we can be ready when 3.0.0 GA is out. With this we can also establish faster cadence for future Hadoop 3.x releases. To this end, I propose to target Hadoop 3.1.0 for a release by mid Jan 2018. (About 4.5 months from now and 2.5 months after 3.0-GA, instead of 6.5 months from now). I'd also want to take this opportunity to come up with a more elaborate release plan to avoid some of the confusion we had with 3.0 beta. General proposal for the timeline (per this other proposal [2]) - Feature freeze date - all features should be merged by Dec 15, 2017. - Code freeze date - blockers/critical only, no more improvements and non blocker/critical bug-fixes: Jan 1, 2018. - Release date: Jan 15, 2018 Following is a list of features on my radar which could be candidates for a 3.1 release: - YARN-5734, Dynamic scheduler queue configuration. (Owner: Jonathan Hung) - YARN-5881, Add absolute resource configuration to CapacityScheduler. (Owner: Sunil) - YARN-5673, Container-executor rewrite for better security, extensibility and portability. (Owner Varun Vasudev) - YARN-6223, GPU isolation. (Owner: Wangda) And from email [3] mentioned by Andrew, there=E2=80=99re several other HDFS features want to be released with 3.1 as well, assuming they fit the timelines: - Storage Policy Satisfier - HDFS tiered storage Please let me know if I missed any features targeted to 3.1 per this timeline. And I want to volunteer myself as release manager of 3.1.0 release. Please let me know if you have any suggestions/concerns. Thanks, Wangda Tan [1] http://markmail.org/message/hwar5f5ap654ck5o?q=3D Branch+merges+and+3%2E0%2E0-beta1+scope [2] http://markmail.org/message/hwar5f5ap654ck5o?q=3DBranch+ merges+and+3%2E0%2E0-beta1+scope#query:Branch%20merges% 20and%203.0.0-beta1%20scope+page:1+mid:2hqqkhl2dymcikf5+state:results [3] http://markmail.org/message/h35obzqrh3ag6dgn?q=3DBranch+merge s+and+3%2E0%2E0-beta1+scope --f403045c2dc09f334305588950fd--