Return-Path: X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 5AF7E189FC for ; Wed, 25 Nov 2015 19:47:49 +0000 (UTC) Received: (qmail 65236 invoked by uid 500); 25 Nov 2015 19:47:48 -0000 Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org Received: (qmail 65139 invoked by uid 500); 25 Nov 2015 19:47:48 -0000 Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-dev@hadoop.apache.org Delivered-To: mailing list common-dev@hadoop.apache.org Received: (qmail 65071 invoked by uid 99); 25 Nov 2015 19:47:47 -0000 Received: from Unknown (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 25 Nov 2015 19:47:47 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 49BCF1A29DC for ; Wed, 25 Nov 2015 19:47:47 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.98 X-Spam-Level: ** X-Spam-Status: No, score=2.98 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=3, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=cloudera-com.20150623.gappssmtp.com Received: from mx1-eu-west.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id 8CuaNd7iM3VC for ; Wed, 25 Nov 2015 19:47:41 +0000 (UTC) Received: from mail-yk0-f174.google.com (mail-yk0-f174.google.com [209.85.160.174]) by mx1-eu-west.apache.org (ASF Mail Server at mx1-eu-west.apache.org) with ESMTPS id CC15420BC2 for ; Wed, 25 Nov 2015 19:47:40 +0000 (UTC) Received: by ykfs79 with SMTP id s79so68183524ykf.1 for ; Wed, 25 Nov 2015 11:47:40 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cloudera-com.20150623.gappssmtp.com; s=20150623; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-type; bh=p863AaXSOWSpb1vzZ0qimVvJY/MQuE6p9QOQ2+Xiyv8=; b=fFYTFMQ0X1MQDrz9dpIIldRXW1jX78/P2ziCfGFXMAw2wSJUHquse5k6rxCSSB4CVg nrZfHdGSiGoX2Afqyptt9doJKysyW8vz6v6MMdnTQ+D1e+B3RPSOi9ZC0cCR5rDhV1wT epgVduoiuzLF3y6OA5dm7UQzhl11+qZeotj6qFXO3XEtyyjPBPhh9NvbVIsO0xqZvckB St1NNPNnAgEQJjTxZU3pehyc0wUi7R8WBpcqnDy799RpAkQfDXYx5odNvKSOgnjbzuK4 C32k2ZUBOCOlqjO/FphRDBdx1G9VkyeChoslzUaKyM4aLT3wppzlguXIjIMdp0tuIrQo GQGA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc:content-type; bh=p863AaXSOWSpb1vzZ0qimVvJY/MQuE6p9QOQ2+Xiyv8=; b=I7sIsGvDkp173lNqqPZLWogNmGwej4b/rhJzoKVKdrlYY6cjJAbHlJsq1yakVq/fKT DGO8vY6uFM7TSnT2v8mXuEieCJ+5DL987NmoIGJQvPMMeC7S1lcYpm1908+yc6vjgiaw fOoDFcivBG//n3iCw+ONpvTn4NEs9+IqmLBoc67UWWcjUvXIiyzOEa2fPjGzmyQEk3ga n/Jlo2ZXyMK84Qz1w5DFuYTxX2U51PdNgLO/beLDxxd/1uUSqpy1KBF9LPFuL3VDQRn1 O6hqdkm4ARQyPXlEfEc9pgEDJU9Y5wJW0PzWl3B+VXG+gK2zR5P3NoG3ScsyTlen7dLo bMaA== X-Gm-Message-State: ALoCoQm1WBdX0eWVQy4HwRqbqMRm05MIj6WH3xTB0CI7FDVwAA/GfyTJJQNhUzx63ZOPrsEeHG+8 X-Received: by 10.129.124.215 with SMTP id x206mr33199770ywc.144.1448480859851; Wed, 25 Nov 2015 11:47:39 -0800 (PST) MIME-Version: 1.0 Received: by 10.129.156.74 with HTTP; Wed, 25 Nov 2015 11:47:20 -0800 (PST) In-Reply-To: References: <0C22896E-D77B-4DE4-99A2-9D81E150779C@hortonworks.com> From: Andrew Wang Date: Wed, 25 Nov 2015 11:47:20 -0800 Message-ID: Subject: Re: [DISCUSS] Looking to a 2.8.0 release To: "hdfs-dev@hadoop.apache.org" Cc: "yarn-dev@hadoop.apache.org" , "mapreduce-dev@hadoop.apache.org" , Hadoop Common Content-Type: multipart/alternative; boundary=001a1149378c1dd4c7052562bb18 --001a1149378c1dd4c7052562bb18 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Hey Vinod, I'm fine with the idea of alpha/beta marking in the abstract, but had a question: do we define these terms in our compatibility policy or elsewhere? I think it's commonly understood among us developers (alpha means not fully tested and API unstable, beta means it's not fully tested but is API stable), but it'd be good to have it written down. Also I think we've only done alpha/beta tagging at the release-level previously which is a simpler story to tell users. So it's important for this release that alpha features set their interface stability annotations to "evolving". There isn't a corresponding annotation for "interface quality", but IMO that's overkill. Thanks, Andrew On Wed, Nov 25, 2015 at 11:08 AM, Vinod Kumar Vavilapalli < vinodkv@apache.org> wrote: > This is the current state from the feedback I gathered. > - Support priorities across applications within the same queue YARN-1963 > =E2=80=94 Can push as an alpha / beta feature per Sunil > - YARN-1197 Support changing resources of an allocated container: > =E2=80=94 Can push as an alpha/beta feature per Wangda > - YARN-3611 Support Docker Containers In LinuxContainerExecutor: Well > most of it anyways. > =E2=80=94 Can push as an alpha feature. > - YARN Timeline Service v1.5 - YARN-4233 > =E2=80=94 Should include per Li Lu > - YARN Timeline Service Next generation: YARN-2928 > =E2=80=94 Per analysis from Sangjin, drop this from 2.8. > > One open feature status > - HDFS-8155 Support OAuth2 in WebHDFS: Alpha / Early feature? > > Updated the Roadmap wiki with the same. > > Thanks > +Vinod > > > On Nov 13, 2015, at 12:12 PM, Sangjin Lee wrote: > > > > I reviewed the current state of the YARN-2928 changes regarding its > impact > > if the timeline service v.2 is disabled. It does appear that there are = a > > lot of things that still do get created and enabled unconditionally > > regardless of configuration. While this is understandable when we were > > working to implement the feature, this clearly needs to be cleaned up s= o > > that when disabled the timeline service v.2 doesn't impact other things= . > > > > I filed a JIRA for that work: > > https://issues.apache.org/jira/browse/YARN-4356 > > > > We need to complete it before we can merge. > > > > Somewhat related is the status of the configuration and what it means i= n > > various contexts (client/app-side vs. server-side, v.1 vs. v.2, etc.). = I > > know there is an ongoing discussion regarding YARN-4183. We'll need to > > reflect the outcome of that discussion. > > > > My overall impression of whether this can be done for 2.8 is that it > looks > > rather challenging given the suggested timeframe. We also need to > complete > > several major tasks before it is ready. > > > > Sangjin > > > > > > On Wed, Nov 11, 2015 at 5:49 PM, Sangjin Lee wrote: > > > >> > >> On Wed, Nov 11, 2015 at 12:13 PM, Vinod Vavilapalli < > >> vinodkv@hortonworks.com> wrote: > >> > >>> =E2=80=94 YARN Timeline Service Next generation: YARN-2928: Lots o= f > momentum, > >>> but clearly a work in progress. Two options here > >>> =E2=80=94 If it is safe to ship it into 2.8 in a disable manne= r, we can > >>> get the early code into trunk and all the way int o2.8. > >>> =E2=80=94 If it is not safe, it organically rolls over into 2.= 9 > >>> > >> > >> I'll review the changes on YARN-2928 to see what impact it has (if any= ) > if > >> the timeline service v.2 is disabled. > >> > >> Another condition for it to make 2.8 is whether the branch will be in = a > >> shape in a couple of weeks such that it adds value for folks that want > to > >> test it. Hopefully it will become clearer soon. > >> > >> Sangjin > >> > > --001a1149378c1dd4c7052562bb18--