Return-Path: X-Original-To: apmail-hadoop-yarn-dev-archive@minotaur.apache.org Delivered-To: apmail-hadoop-yarn-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 2CD2A180A6 for ; Wed, 28 Oct 2015 17:44:48 +0000 (UTC) Received: (qmail 96346 invoked by uid 500); 28 Oct 2015 17:43:46 -0000 Delivered-To: apmail-hadoop-yarn-dev-archive@hadoop.apache.org Received: (qmail 96273 invoked by uid 500); 28 Oct 2015 17:43:46 -0000 Mailing-List: contact yarn-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: yarn-dev@hadoop.apache.org Delivered-To: mailing list yarn-dev@hadoop.apache.org Received: (qmail 96229 invoked by uid 99); 28 Oct 2015 17:43:46 -0000 Received: from mail-relay.apache.org (HELO mail-relay.apache.org) (140.211.11.15) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 28 Oct 2015 17:43:46 +0000 Received: from mail-ob0-f171.google.com (mail-ob0-f171.google.com [209.85.214.171]) by mail-relay.apache.org (ASF Mail Server at mail-relay.apache.org) with ESMTPSA id F10E71A05E7; Wed, 28 Oct 2015 17:43:45 +0000 (UTC) Received: by obcqt19 with SMTP id qt19so12691011obc.3; Wed, 28 Oct 2015 10:43:45 -0700 (PDT) MIME-Version: 1.0 X-Received: by 10.182.70.101 with SMTP id l5mr31812636obu.51.1446054225254; Wed, 28 Oct 2015 10:43:45 -0700 (PDT) Received: by 10.202.197.200 with HTTP; Wed, 28 Oct 2015 10:43:45 -0700 (PDT) In-Reply-To: <9FC1F956-7C15-4FF9-841F-1E0E5C6AC05C@hortonworks.com> References: <55A754CA.6060301@oss.nttdata.co.jp> <621877812.236842.1445958775552.JavaMail.yahoo@mail.yahoo.com> <9FC1F956-7C15-4FF9-841F-1E0E5C6AC05C@hortonworks.com> Date: Thu, 29 Oct 2015 02:43:45 +0900 Message-ID: Subject: Re: 2.7.2 release plan From: Tsuyoshi Ozawa To: Vinod Vavilapalli Cc: "yarn-dev@hadoop.apache.org" , "hdfs-dev@hadoop.apache.org" , "common-dev@hadoop.apache.org" , Vinod Kumar Vavilapalli , Wangda Tan , Tsuyoshi Ozawa , "Naganarasimha G R (Naga)" Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Vinod, Thank you for taking care of this. I've checked the list of changes. As a result, I agree that we don't have enough time to backport these changes into 2.7.2 by this weekend. For a fast move, it's better suggestion to me to backport these tickets into 2.7.3. Best, - Tsuyoshi On Thu, Oct 29, 2015 at 2:19 AM, Vinod Vavilapalli wrote: > Tsuyoshi / Wangda / Naga, > > This looks too big of a list to me if we have to cut an RC by this weeken= d per my plan. > > I=E2=80=99d suggest a fast move on things you think are low risk enough a= nd punt everything else for next release. > > Thanks > +Vinod > >> On Oct 28, 2015, at 3:08 AM, Naganarasimha G R (Naga) wrote: >> >> Thanks Tsuyoshi, >> If required even i can pitch in :) >> Additional to this we added the support in Mapreduce for labels in MAPRE= DUCE-6304, >> >> Regards, >> + Naga >> ________________________________________ >> From: Tsuyoshi Ozawa [ozawa@apache.org] >> Sent: Wednesday, October 28, 2015 14:28 >> To: yarn-dev@hadoop.apache.org >> Cc: hdfs-dev@hadoop.apache.org; common-dev@hadoop.apache.org; Vinod Kuma= r Vavilapalli; Wangda tan >> Subject: Re: 2.7.2 release plan >> >> Thank you for reporting, Naganarasimha. >> Vinod and Wangda, I will help you to backport these changes. >> >> Best, >> - Tsuyoshi >> >> On Wed, Oct 28, 2015 at 2:57 PM, Naganarasimha G R (Naga) >> wrote: >>> Hi Vinod, & Wangda >>> >>> I think it would be good to backport, following jira's related to NodeL= abels as it will improve debug ability and usability of NodeLabels >>> -------------------------------- >>> Key Summary >>> -------------------------------- >>> YARN-4215 YARN-2492 RMNodeLabels Manager Need to verify and repla= ce node labels for the only modified Node Label Mappings in the request >>> YARN-4162 YARN-2492 CapacityScheduler: Add resource usage by part= ition and queue capacity by partition to REST API >>> YARN-4140 YARN-2492 RM container allocation delayed incase of app= submitted to Nodelabel partition >>> YARN-3717 YARN-2492 Expose app/am/queue's node-label-expression t= o RM web UI / CLI / REST-API >>> YARN-3647 YARN-2492 RMWebServices api's should use updated api fr= om CommonNodeLabelsManager to get NodeLabel object >>> YARN-3593 YARN-2492 Add label-type and Improve "DEFAULT_PARTITION= " in Node Labels Page >>> YARN-3583 YARN-2492 Support of NodeLabel object instead of plain = String in YarnClient side. >>> YARN-3581 YARN-2492 Deprecate -directlyAccessNodeLabelStore in RM= AdminCLI >>> YARN-3579 YARN-2492 CommonNodeLabelsManager should support NodeLa= bel instead of string label name when getting node-to-label/label-to-label = mappings >>> YARN-3565 YARN-2492 NodeHeartbeatRequest/RegisterNodeManagerReque= st should use NodeLabel object instead of String >>> YARN-3521 YARN-2492 Support return structured NodeLabel objects i= n REST API >>> YARN-3362 YARN-2492 Add node label usage in RM CapacityScheduler = web UI >>> YARN-3326 YARN-2492 Support RESTful API for getLabelsToNodes >>> YARN-3216 YARN-2492 Max-AM-Resource-Percentage should respect nod= e labels >>> YARN-3136 YARN-3091 getTransferredContainers can be a bottleneck = during AM registration >>> >>> Please inform if any support is required to backport them to 2.7.2 >>> >>> Regards, >>> + Naga >>> ________________________________________ >>> From: Kihwal Lee [kihwal@yahoo-inc.com.INVALID] >>> Sent: Tuesday, October 27, 2015 20:42 >>> To: hdfs-dev@hadoop.apache.org; common-dev@hadoop.apache.org >>> Cc: Chris Nauroth; yarn-dev@hadoop.apache.org; mapreduce-dev@hadoop.apa= che.org; Vinod Kumar Vavilapalli; Ming Ma >>> Subject: Re: 2.7.2 release plan >>> >>> I think we need HDFS-8950 and HDFS-7725 in 2.7.2.It should be easy to b= ackport/cherry-pick HDFS-7725. For HDFS-8950, it will be nice if Ming can c= hime in. >>> Kihwal >>> >>> From: Tsuyoshi Ozawa >>> To: "common-dev@hadoop.apache.org" >>> Cc: Chris Nauroth ; "yarn-dev@hadoop.apache.o= rg" ; "hdfs-dev@hadoop.apache.org" ; "mapreduce-dev@hadoop.apache.org" ; Vinod Kumar Vavilapalli >>> Sent: Tuesday, October 27, 2015 2:39 AM >>> Subject: Re: 2.7.2 release plan >>> >>> Vinod and Chris, >>> >>> Thanks for your reply. I'll do also backport not only bug fixes but >>> also documentations(I think 2.7.2 includes them). It helps users a lot. >>> >>> Best, >>> - Tsuyoshi >>> >>> On Tuesday, 27 October 2015, Vinod Vavilapalli >>> wrote: >>> >>>> +1. >>>> >>>> Thanks >>>> +Vinod >>>> >>>>> On Jul 16, 2015, at 8:18 AM, Chris Nauroth >>> > wrote: >>>>> >>>>> I'd be comfortable with inclusion of any doc-only patch in minor >>>> releases. >>>>> There is a lot of value to end users in pushing documentation fixes a= s >>>>> quickly as possible, and they don't bear the same risk of regressions= or >>>>> incompatibilities as code changes. >>>>> >>>>> --Chris Nauroth >>>>> >>>>> >>>>> >>>>> >>>>> On 7/16/15, 12:38 AM, "Tsuyoshi Ozawa" > >>>> wrote: >>>>> >>>>>> Hi, >>>>>> >>>>>> thank you for starting the discussion about 2.7.2 release. >>>>>> >>>>>>> The focus obviously is to have blocker issues [2], bug-fixes and *n= o* >>>>>> features / improvements. >>>>>> >>>>>> I've committed YARN-3170, which is an improvement of documentation. = I >>>>>> thought documentation pages which can be fit into branch-2.7 can be >>>>>> included easily. Should I revert it? >>>>>> >>>>>>>> I need help from all committers in automatically >>>>>> merging in any patch that fits the above criterion into 2.7.2 instea= d of >>>>>> only on trunk or 2.8. >>>>>> >>>>>> Sure, I'll try my best. >>>>>> >>>>>>> That way we can include not only blocker but also critical bug fixe= s to >>>>>>> 2.7.2 release. >>>>>> >>>>>> As Vinod mentioned, we should also apply major bug fixes into >>>> branch-2.7. >>>>>> >>>>>> Thanks, >>>>>> - Tsuyoshi >>>>>> >>>>>> On Thu, Jul 16, 2015 at 3:52 PM, Akira AJISAKA >>>>>> > wrote: >>> >>> >>>>>>> Thanks Vinod for starting 2.7.2 release plan. >>>>>>> >>>>>>>> The focus obviously is to have blocker issues [2], bug-fixes and *= no* >>>>>>>> features / improvements. >>>>>>> >>>>>>> Can we adopt the plan as Karthik mentioned in "Additional maintenan= ce >>>>>>> releases for Hadoop 2.y versions" thread? That way we can include n= ot >>>>>>> only >>>>>>> blocker but also critical bug fixes to 2.7.2 release. >>>>>>> >>>>>>> In addition, branch-2.7 is a special case. (2.7.1 is the first stab= le >>>>>>> release) Therefore I'm thinking we can include major bug fixes as w= ell. >>>>>>> >>>>>>> Regards, >>>>>>> Akira >>>>>>> >>>>>>> >>>>>>> On 7/16/15 04:13, Vinod Kumar Vavilapalli wrote: >>>>>>>> >>>>>>>> Hi all, >>>>>>>> >>>>>>>> >>>>>>>> Thanks everyone for the push on 2.7.1! Branch-2.7 is now open for >>>>>>>> commits >>>>>>>> to a 2.7.2 release. JIRA also now has a 2.7.2 version for all the >>>>>>>> sub-projects. >>>>>>>> >>>>>>>> >>>>>>>> Continuing the previous 2.7.1 thread on steady maintenance release= s >>>>>>>> [1], >>>>>>>> we >>>>>>>> should follow up 2.7.1 with a 2.7.2 within 4 weeks. Earlier I trie= d a >>>>>>>> 2-3 >>>>>>>> week cycle for 2.7.1, but it seems to be impractical given the >>>>>>>> community >>>>>>>> size. So, I propose we target a release by the end for 4 weeks fro= m >>>>>>>> now, >>>>>>>> starting the release close-down within 2-3 weeks. >>>>>>>> >>>>>>>> The focus obviously is to have blocker issues [2], bug-fixes and *= no* >>>>>>>> features / improvements. I need help from all committers in >>>>>>>> automatically >>>>>>>> merging in any patch that fits the above criterion into 2.7.2 inst= ead >>>>>>>> of >>>>>>>> only on trunk or 2.8. >>>>>>>> >>>>>>>> Thoughts? >>>>>>>> >>>>>>>> Thanks, >>>>>>>> >>>>>>>> +Vinod >>>>>>>> >>>>>>>> [1] A 2.7.1 release to follow up 2.7.0 >>>>>>>> http://markmail.org/message/zwzze6cqqgwq4rmw >>>>>>>> >>>>>>>> [2] 2.7.2 release blockers: >>>>>>>> https://issues.apache.org/jira/issues/?filter=3D12332867 >>>>>>>> >>>>>>> >>>>>> >>>>> >>>>> >>>> >>>> >>> >>> >> >