From hdfs-dev-return-32741-archive-asf-public=cust-asf.ponee.io@hadoop.apache.org Thu May 24 00:31:10 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id CD92A180645 for ; Thu, 24 May 2018 00:31:09 +0200 (CEST) Received: (qmail 70384 invoked by uid 500); 23 May 2018 22:31:08 -0000 Mailing-List: contact hdfs-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list hdfs-dev@hadoop.apache.org Received: (qmail 70349 invoked by uid 99); 23 May 2018 22:31:07 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 23 May 2018 22:31:07 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 8F7E51A3C4E for ; Wed, 23 May 2018 22:31:07 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.879 X-Spam-Level: * X-Spam-Status: No, score=1.879 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=cloudera.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id SPqcCErFMapn for ; Wed, 23 May 2018 22:31:04 +0000 (UTC) Received: from mail-oi0-f68.google.com (mail-oi0-f68.google.com [209.85.218.68]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 793C05F188 for ; Wed, 23 May 2018 22:31:03 +0000 (UTC) Received: by mail-oi0-f68.google.com with SMTP id k5-v6so21008288oiw.0 for ; Wed, 23 May 2018 15:31:03 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cloudera.com; s=google; h=mime-version:from:date:message-id:subject:to:cc; bh=qlu4B8NXsEIOTvsapIKBnXbwMGOtdPgvFvp99itBx18=; b=FVHgQHFNG8qx0TCklKJqnGFtwe5XeQ2IzGGF1eTjf8OpEaSX565VZTvKWwMXgQGJED OQ4370oPTEYBwCkV7HuNeAPgBYj1wNSOhhgXAAWX2c4LDf9Avyw+EVooAnuZrP3exh8Z s3RDo3n26JAkDYkq8fDEqBh0v/S53OQ0vc9ytjXLf1+0dHsm4LLVwAF4ndd9v/NZ+PAS V8q8bZd7MVT6uXxPJH+ZeqB64UqrD/zHYo0I1kIL54U/Q6VyINUPopo7o2iJht0ysozS W8udtXv/uIjvHoyhaJW8k72Nz2+F/GenJ2OuFQ6d+/ni2WdotoRp5eKMd30ZOkuwC1tY Zh4Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to:cc; bh=qlu4B8NXsEIOTvsapIKBnXbwMGOtdPgvFvp99itBx18=; b=ATVYRv+pIF2Zr8gucSYvikNR8mMYQ8b/25orIHfA+Y2T7u4DfG3ti/I1fvn9mRbYwQ 8yUBOguZkGVs/Uh5W6w8dd19uDEtmhbHLg443hwFCgeaVPrO76pKWwwTpXEUAX2/+2eq 6NMFeaj8EROS3Da/bgnLuBvPfg1b0Ai0BpPmCmvEacx6jCrUhs/e4icwAWRRxuCHS3j2 zZRK+1hMtNjVIPOsrWoKkBTURyjgpSlWidM4WAReem1M/lPmxVJjhbpxMVq+P73Irwaj plz+V1krYF+dyMqnf7hqebaapVsyXggjXzZQdP4G9iUSLD9PkAtiV0MIxG2XzuqGF0f2 YRjg== X-Gm-Message-State: ALKqPwcvdII3M3U3+xERSyf5cT/YAZNsZEhOwMv67DN0hexHTaEq7Uti A3A2RzVEGb5dkWT/EMXdt7RZa8cVt9U7nhIuYSQCgQ== X-Google-Smtp-Source: AB8JxZrrkzHgnuFK+R/0ut6voHF7oaAGaVeWQ/zLfJvoT/J8gY+/LCmrNczcWxso5xv5RB64QL0zlMXO0BmLds6LoI0= X-Received: by 2002:aca:45d5:: with SMTP id s204-v6mr2441140oia.52.1527114662145; Wed, 23 May 2018 15:31:02 -0700 (PDT) MIME-Version: 1.0 Received: by 2002:a4a:84f:0:0:0:0:0 with HTTP; Wed, 23 May 2018 15:31:01 -0700 (PDT) From: Yongjun Zhang Date: Wed, 23 May 2018 15:31:01 -0700 Message-ID: Subject: Re: Apache Hadoop 3.0.3 Release plan To: Eric Badger Cc: Vrushali C , Sean Busbey , Haibo Chen , Wei-Chiu Chuang , Vrushali Channapattan , Rohith Sharma K S , Eric Payne , Hadoop Common , mapreduce-dev@hadoop.apache.org, yarn-dev@hadoop.apache.org, Hdfs-dev Content-Type: multipart/alternative; boundary="000000000000f8256e056ce7163d" --000000000000f8256e056ce7163d Content-Type: text/plain; charset="UTF-8" Thanks Eric. Sounds good. I may try to see if I can do the branching/RC sooner. --Yongjun On Wed, May 23, 2018 at 2:18 PM, Eric Badger wrote: > My thinking is to cut the branch in next couple of days and create RC for > vote at the end of month. > > We plan to cut branch-3.0.3 by the coming Wednesday (May 9th) and > vote for RC on May 30th > I much prefer to wait to cut the branch until just before the production > of the release and the vote. With so many branches, we sometimes miss > putting critical bug fixes in unreleased branches if the branch is cut > too early. > > Echoing Eric Payne, I think we should wait to cut the branch until we are > actually creating the RC to vote on (i.e. on May 29 or 30 if the vote is to > be on May 30). > > Eric > > > > On Wed, May 23, 2018 at 4:11 PM, Yongjun Zhang > wrote: > >> Hi, >> >> I have gardened the jiras for 3.0.3, and have the following open issues: >> >> https://issues.apache.org/jira/issues/?filter=12343970 >> >> Two of them are blockers, one of them (YARN-8346) has already got +1 for >> patch, the other (YARN-8108) will take longer time to resolve and it seems >> we can possibly push it to next release given 3.0.2 also has the issue. >> >> My thinking is to cut the branch in next couple of days and create RC for >> vote at the end of month. >> >> Comments are welcome. >> >> Thanks, >> >> --Yongjun >> >> On Tue, May 8, 2018 at 11:40 AM, Vrushali C >> wrote: >> >> > +1 for including the YARN-7190 patch in 3.0.3 release. This is a fix >> that >> > will enable HBase to use Hadoop 3.0.x in the production line. >> > >> > thanks >> > Vrushali >> > >> > >> > On Tue, May 8, 2018 at 10:24 AM, Yongjun Zhang >> > wrote: >> > >> >> Thanks Wei-Chiu and Haibo for the feedback! >> >> >> >> Good thing is that I have made the following note couple of days ago >> when >> >> I >> >> looked the at branch diff, so we are on the same page: >> >> >> >> 496dc57 Revert "YARN-7190. Ensure only NM classpath in 2.x gets >> TSv2 >> >> related hbase jars, not the user classpath. Contributed by Varun >> Saxena." >> >> >> >> *YARN-7190 is not in 3.0.2, I will include it in 3.0.3 per* the >> comment >> >> below: >> >> https://issues.apache.org/jira/browse/YARN-7190?focusedComme >> >> ntId=16457649& >> >> page=com.atlassian.jira.plugin.system.issuetabpanels >> >> > entId=16457649&page=com.atlassian.jira.plugin.system.issuetabpanels> >> >> >> : >> >> comment-tabpanel#comment-16457649 >> >> >> >> >> >> In addition, I will revert https://issues.apache.org/ >> >> jira/browse/HADOOP-13055 from 3.0.3 since it's a feature. >> >> >> >> >> >> Best, >> >> >> >> --Yongjun >> >> >> >> On Tue, May 8, 2018 at 8:57 AM, Haibo Chen >> >> wrote: >> >> >> >> > +1 on adding YARN-7190 to Hadoop 3.0.x despite the fact that it is >> >> > technically incompatible. >> >> > It is critical enough to justify being an exception, IMO. >> >> > >> >> > Added Rohith and Vrushali >> >> > >> >> > On Tue, May 8, 2018 at 6:20 AM, Wei-Chiu Chuang >> >> > wrote: >> >> > >> >> >> Thanks Yongjun for driving 3.0.3 release! >> >> >> >> >> >> IMHO, could we consider adding YARN-7190 >> >> >> into the list? >> >> >> I understand that it is listed as an incompatible change, however, >> >> because >> >> >> of this bug, HBase considers the entire Hadoop 3.0.x line not >> >> production >> >> >> ready. I feel there's not much point releasing any more 3.0.x >> releases >> >> if >> >> >> downstream projects can't pick it up (after the fact that HBase is >> one >> >> of >> >> >> the most important projects around Hadoop). >> >> >> >> >> >> On Mon, May 7, 2018 at 1:19 PM, Yongjun Zhang >> >> >> wrote: >> >> >> >> >> >> > Hi Eric, >> >> >> > >> >> >> > Thanks for the feedback, good point. I will try to clean up >> things, >> >> then >> >> >> > cut branch before the release production and vote. >> >> >> > >> >> >> > Best, >> >> >> > >> >> >> > --Yongjun >> >> >> > >> >> >> > On Mon, May 7, 2018 at 8:39 AM, Eric Payne < >> eric.payne1000@yahoo.com >> >> . >> >> >> > invalid >> >> >> > > wrote: >> >> >> > >> >> >> > > > We plan to cut branch-3.0.3 by the coming Wednesday (May 9th) >> >> and >> >> >> vote >> >> >> > > for RC on May 30th >> >> >> > > I much prefer to wait to cut the branch until just before the >> >> >> production >> >> >> > > of the release and the vote. With so many branches, we sometimes >> >> miss >> >> >> > > putting critical bug fixes in unreleased branches if the branch >> is >> >> cut >> >> >> > too >> >> >> > > early. >> >> >> > > >> >> >> > > My 2 cents... >> >> >> > > Thanks, >> >> >> > > -Eric Payne >> >> >> > > >> >> >> > > >> >> >> > > >> >> >> > > >> >> >> > > >> >> >> > > On Monday, May 7, 2018, 12:09:00 AM CDT, Yongjun Zhang < >> >> >> > > yjzhangal@apache.org> wrote: >> >> >> > > >> >> >> > > >> >> >> > > >> >> >> > > >> >> >> > > >> >> >> > > Hi All, >> >> >> > > >> >> >> > > > >> >> >> > > We have released Apache Hadoop 3.0.2 in April of this year [1]. >> >> Since >> >> >> > then, >> >> >> > > there are quite some commits done to branch-3.0. To further >> improve >> >> >> the >> >> >> > > quality of release, we plan to do 3.0.3 release now. The focus >> of >> >> >> 3.0.3 >> >> >> > > will be fixing blockers (3), critical bugs (17) and bug fixes >> >> (~130), >> >> >> see >> >> >> > > [2]. >> >> >> > > >> >> >> > > Usually no new feature should be included for maintenance >> >> releases, I >> >> >> > > noticed we have https://issues.apache.org/jira >> /browse/HADOOP-13055 >> >> in >> >> >> > the >> >> >> > > branch classified as new feature. I will talk with the >> developers >> >> to >> >> >> see >> >> >> > if >> >> >> > > we should include it in 3.0.3. >> >> >> > > >> >> >> > > I also noticed that there are more commits in the branch than >> can >> >> be >> >> >> > found >> >> >> > > by query [2], also some commits committed to 3.0.3 do not have >> >> their >> >> >> jira >> >> >> > > target release field filled in accordingly. I will go through >> them >> >> to >> >> >> > > update the jira. >> >> >> > > >> >> >> > > > >> >> >> > > We plan to cut branch-3.0.3 by the coming Wednesday (May 9th) >> and >> >> vote >> >> >> > for >> >> >> > > RC on May 30th, targeting for Jun 8th release. >> >> >> > > >> >> >> > > > >> >> >> > > Your insights are welcome. >> >> >> > > >> >> >> > > > >> >> >> > > [1] https://www.mail-archive.com/g >> eneral@hadoop.apache.org/msg07 >> >> >> 790.html >> >> >> > > >> >> >> > > > [2] https://issues.apache.org/jira/issues/?filter=12343874 >> See >> >> >> Note >> >> >> > > below >> >> >> > > Note: seems I need some admin change so that I can make the >> filter >> >> in >> >> >> [2] >> >> >> > > public, I'm working on that. For now, you can use jquery >> >> >> > > (project = hadoop OR project = "Hadoop HDFS" OR project = >> "Hadoop >> >> >> YARN" >> >> >> > OR >> >> >> > > project = "Hadoop Map/Reduce") AND fixVersion in (3.0.3) ORDER >> BY >> >> >> > priority >> >> >> > > DESC >> >> >> > > >> >> >> > > Thanks and best regards, >> >> >> > > >> >> >> > > --Yongjun >> >> >> > > >> >> >> > > ------------------------------------------------------------ >> >> --------- >> >> >> > > To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hado >> >> op.apache.org >> >> >> > > For additional commands, e-mail: mapreduce-dev-help@hadoop.apac >> >> he.org >> >> >> > > >> >> >> > > >> >> >> > >> >> >> >> >> >> >> >> >> >> >> >> -- >> >> >> A very happy Hadoop contributor >> >> >> >> >> > >> >> > >> >> >> > >> > >> > > --000000000000f8256e056ce7163d--