Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id BDFD9200B38 for ; Fri, 8 Jul 2016 18:08:53 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id BC9D5160A5A; Fri, 8 Jul 2016 16:08:53 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 11698160A36 for ; Fri, 8 Jul 2016 18:08:52 +0200 (CEST) Received: (qmail 35163 invoked by uid 500); 8 Jul 2016 16:08:52 -0000 Mailing-List: contact yarn-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list yarn-dev@hadoop.apache.org Received: (qmail 35148 invoked by uid 99); 8 Jul 2016 16:08:52 -0000 Received: from mail-relay.apache.org (HELO mail-relay.apache.org) (140.211.11.15) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 08 Jul 2016 16:08:52 +0000 Received: from spacestar.att.net (107-222-184-213.lightspeed.sntcca.sbcglobal.net [107.222.184.213]) by mail-relay.apache.org (ASF Mail Server at mail-relay.apache.org) with ESMTPSA id A769A1A01BB; Fri, 8 Jul 2016 16:08:51 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 9.3 \(3124\)) Subject: Re: [VOTE] merge feature branch YARN-2928 From: Vinod Kumar Vavilapalli In-Reply-To: Date: Fri, 8 Jul 2016 09:08:50 -0700 Cc: "yarn-dev@hadoop.apache.org" Content-Transfer-Encoding: quoted-printable Message-Id: <58D62A90-E091-41DE-A8D7-49F63AA9CD43@apache.org> References: To: Sangjin Lee X-Mailer: Apple Mail (2.3124) archived-at: Fri, 08 Jul 2016 16:08:53 -0000 +1 binding. Thanks +Vinod > On Jul 1, 2016, at 9:00 AM, Sangjin Lee wrote: >=20 > Hi folks, >=20 > Per earlier discussion [1], I'd like to start a formal vote to merge > feature branch YARN-2928 [2] (Timeline Service v.2) to trunk. The vote = will > run for 7 days, and will end July 8 9:00 AM PDT. >=20 > We have been developing the feature in a feature branch (YARN-2928 = [3]) for > a while, and we are reasonably confident that the state of the feature > meets the criteria to be merged onto trunk and we'd love folks to get = their > hands on it in a test capacity and provide valuable feedback so that = we can > make it production-ready. >=20 > In a nutshell, Timeline Service v.2 delivers significant scalability = and > usability improvements based on a new architecture. You can browse the > requirements/design doc, the storage schema doc, the new entity/data = model, > the YARN documentation, and also discussions on subsequent milestones = on > YARN-2928 [2]. >=20 > What we would like to merge to trunk is termed "alpha 1" (milestone = 1). The > feature has a complete end-to-end read/write flow, and you should be = able > to start setting it up and testing it. At a high level, the following = are > the key features that have been implemented: >=20 > - distributed writers (collectors) as NM aux services > - HBase storage > - new entity model that includes flows > - setting the flow context via YARN app tags > - real time metrics aggregation to the application level and the flow = level > - rich REST API that supports filters, complex conditionals, limits, > content selection, etc. > - YARN generic events and system metrics > - integration with Distributed Shell and MapReduce >=20 > There are a total of 139 subtasks that were completed as part of this > effort. >=20 > We paid close attention to ensure that once disabled Timeline Service = v.2 > does not impact existing functionality when disabled (by default). >=20 > Special thanks go to all the folks who worked real hard on this = feature: Li > Lu, Junping Du, Vinod Kumar Vavilapalli, Naga G. R., Varun Saxena, = Vrushali > C, and Joep Rottinghuis! >=20 > Regards, > Sangjin >=20 > [1] > = https://lists.apache.org/thread.html/314288f399f5ef96b2f4f1fc055ac5d440310= c8d98ace9a0045e8729@%3Cyarn-dev.hadoop.apache.org%3E > [2] https://issues.apache.org/jira/browse/YARN-2928 > [3] https://github.com/apache/hadoop/commits/YARN-2928 --------------------------------------------------------------------- To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org For additional commands, e-mail: yarn-dev-help@hadoop.apache.org