Return-Path: X-Original-To: apmail-hbase-dev-archive@www.apache.org Delivered-To: apmail-hbase-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 1E18218048 for ; Wed, 15 Jul 2015 23:08:14 +0000 (UTC) Received: (qmail 32588 invoked by uid 500); 15 Jul 2015 23:08:13 -0000 Delivered-To: apmail-hbase-dev-archive@hbase.apache.org Received: (qmail 32505 invoked by uid 500); 15 Jul 2015 23:08:13 -0000 Mailing-List: contact dev-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hbase.apache.org Delivered-To: mailing list dev@hbase.apache.org Received: (qmail 32492 invoked by uid 99); 15 Jul 2015 23:08:13 -0000 Received: from Unknown (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 15 Jul 2015 23:08:13 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id B34BAD4DDA for ; Wed, 15 Jul 2015 23:08:12 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 3.001 X-Spam-Level: *** X-Spam-Status: No, score=3.001 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HEADER_FROM_DIFFERENT_DOMAINS=0.001, HTML_MESSAGE=3, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-eu-west.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id dSFgWWG_NL2B for ; Wed, 15 Jul 2015 23:08:00 +0000 (UTC) Received: from mail-ig0-f175.google.com (mail-ig0-f175.google.com [209.85.213.175]) by mx1-eu-west.apache.org (ASF Mail Server at mx1-eu-west.apache.org) with ESMTPS id 6082020D76 for ; Wed, 15 Jul 2015 23:07:59 +0000 (UTC) Received: by igbpg9 with SMTP id pg9so1050462igb.0 for ; Wed, 15 Jul 2015 16:07:58 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type; bh=O3ZdxCr2hRs6/G2aIJdsI1ejPB58OFZyUnioTrlr/Ks=; b=KvnxmS7L28tLkKTtsARzvNPHjwN0Fm6aWNp++iADbaSK8+ZiqeecLaNwDhp35TVaqL i5dRZU+J/dDLq9VwLQFoIRpHYIGkS8O6bIhXrCDb24mYAvQHwINxbjMseuYZjA2zlH8V t9linICdwa8UMFSvpWTeNAFeAaBpIZgeE3Am9AezxcSiWVpbu3PHlO4HiOkeM4M+5L+b 9u7ncnhAgOhGArYkbt+jgrnrjLNF0/6EtuI+UCcGuz+6HOdnPsLl1DkGhuB6W6/aaksQ XkQ5PlBo94X10UZt98bfjRl4yZkDva824Kk0FFPLTV8amLSvQsQSVsUE+ZX6U4EAYEuF Lq9A== MIME-Version: 1.0 X-Received: by 10.50.50.229 with SMTP id f5mr575001igo.35.1437001678382; Wed, 15 Jul 2015 16:07:58 -0700 (PDT) Sender: saint.ack@gmail.com Received: by 10.36.47.21 with HTTP; Wed, 15 Jul 2015 16:07:58 -0700 (PDT) In-Reply-To: References: <8EEFDE39-D690-4F16-A48F-26C93DD7E8ED@hortonworks.com> Date: Wed, 15 Jul 2015 16:07:58 -0700 X-Google-Sender-Auth: E5lMZ9HS2BOd7cvpnyHGMJkG_yI Message-ID: Subject: Re: [DISCUSS] Additional maintenance releases for Hadoop 2.y versions From: Stack To: "common-dev@hadoop.apache.org" Cc: dev Content-Type: multipart/alternative; boundary=047d7bd752e494ed4b051af20680 --047d7bd752e494ed4b051af20680 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Is there anyone interested in volunteering to run a 2.6.1 release (Akira?)? You'd get some help (especially if the bar is set high and only critical bug fixes are allowed in: i.e. no features, no 'perf' fixes, no jar updates, and so on). St.Ack On Wed, Jul 15, 2015 at 3:07 PM, Chris Douglas wrote: > On Wed, Jul 15, 2015 at 2:07 PM, Sean Busbey wrote: > > Alternatively, why not appoint a Release Manager for the minor release > line > > and then allow them to arbitrate when there's disagreement about > inclusion? > > This has worked well in the HBase community. > > > Release managers aren't appointed in Hadoop. Any committer can RM a > release branch and encourage others to help with it. An RM can set the > bar arbitrarily, but an RC only becomes a release when a majority of > PMC votes approve it in a VOTE. -C > > On Wed, Jul 15, 2015 at 2:07 PM, Sean Busbey wrote: > > Why not just include all backwards compatible bug fixes? > > > > Alternatively, why not appoint a Release Manager for the minor release > line > > and then allow them to arbitrate when there's disagreement about > inclusion? > > This has worked well in the HBase community. > > > > On Wed, Jul 15, 2015 at 3:49 PM, Karthik Kambatla > > wrote: > > > >> As I proposed in the other thread, how about we adopting the following > >> model: > >> > >> x.y.1 releases have all Blocker, Critical, Major bug fixes applied to > the > >> next minor release. > >> x.y.2 releases have all Blocker, Critical bug fixes applied to the nex= t > >> minor release. > >> x.y.3 releases have all Blocker bug fixes applied to next minor releas= e. > >> > >> Here I am assuming there are no security-fix-only or other urgent > releases. > >> > >> We could apply this approach for 2.7.x onwards, and do an adhoc 2.6 > >> release. > >> > >> On Wed, Jul 15, 2015 at 12:59 PM, Vinod Kumar Vavilapalli < > >> vinodkv@hortonworks.com> wrote: > >> > >> > Yeah, I started a thread while back on this one ( > >> > http://markmail.org/message/sbykjn5xgnksh6wg) and had many offline > >> > discussions re 2.6.1. > >> > > >> > The biggest problem I found offline was about what bug-fixes are > >> > acceptable and what aren=E2=80=99t for everyone wishing to consume 2= .6.1. > Given > >> the > >> > number of bug-fixes that went into 2.7.x and into branch-2.8, figuri= ng > >> out > >> > a set of patches that is acceptable for everyone is a huge challenge > >> which > >> > kind of stalled my attempts. > >> > > >> > Thanks > >> > +Vinod > >> > > >> > > >> > > On Jul 15, 2015, at 8:57 AM, Sangjin Lee wrote: > >> > > > >> > > Strong +1 for having a 2.6.1 release. I understand Vinod has been > >> trying > >> > to > >> > > get that effort going but it's been stalled a little bit. It would > be > >> > good > >> > > to rekindle that effort. > >> > > > >> > > Companies with big hadoop 2.x deployments (including mine) have > always > >> > > tried to stabilize a 2.x release by testing/collecting/researching > >> > critical > >> > > issues on the release. Each would come up with its own set of fixe= s > to > >> > > backport. We would also communicate it via offline channels. Durin= g > the > >> > > hadoop summit, we thought it would be great if we all came togethe= r > and > >> > > create a public stability/bugfix release on top of 2.x (2.6.1 for > 2.6 > >> for > >> > > example) with all the critical issues fixed. > >> > > > >> > > Thanks, > >> > > Sangjin > >> > > > >> > > > >> > > On Tue, Jul 14, 2015 at 10:42 PM, Tsuyoshi Ozawa > >> > wrote: > >> > > > >> > >> Thank you for the notification. Trying to back port bug fixes. > >> > >> > >> > >> - Tsuyoshi > >> > >> > >> > >> On Wed, Jul 15, 2015 at 3:45 AM, Sean Busbey > >> > wrote: > >> > >>> Hi Hadoopers! > >> > >>> > >> > >>> Over in HBase we've been discussing the impact of our > dependencies on > >> > our > >> > >>> downstream users. As our most fundamental dependency, Hadoop > plays a > >> > big > >> > >>> role in the operational cost of running an HBase instance. > >> > >>> > >> > >>> Currently the HBase 1.y release line supports Hadoop 2.4, 2.5, a= nd > >> > >> 2.6[1]. > >> > >>> We don't drop Hadoop minor release lines in minor releases so we > are > >> > >>> unlikely remove anything from this set until HBase 2.0, probably > at > >> the > >> > >> end > >> > >>> of 2015 / start of 2016 (and currently we plan to continue > supporting > >> > at > >> > >>> least 2.4 for HBase 2.0 [2]). Lately we've been discussing > updating > >> our > >> > >>> shipped binaries to Hadoop 2.6, following some stability testing > by > >> > part > >> > >> of > >> > >>> our community[3]. Unfortunately, 2.6.0 in particular has a coupl= e > of > >> > bugs > >> > >>> that could destroy HBase clusters should users decide to turn on > HDFS > >> > >>> encryption[4]. Our installation instructions tell folks to repla= ce > >> > these > >> > >>> jars with the version of Hadoop they are actually running, but n= ot > >> all > >> > >>> users follow those instructions so we want to minimize the pain > for > >> > them. > >> > >>> > >> > >>> Regular maintenance releases are key to keeping operational > burdens > >> low > >> > >> for > >> > >>> our downstream users; we don't want them to be forced to choose > >> between > >> > >>> living with broken systems and stomaching the risk of upgrades > across > >> > >>> minor/major version numbers. Looking back over the three > >> aforementioned > >> > >>> Hadoop versions, 2.6 hasn't had a patch release since 2.6.0 came > out > >> in > >> > >> Nov > >> > >>> 2014, when 2.5 had its last patch release as well. Hadoop 2.4 > looks > >> to > >> > >> be a > >> > >>> year without a release[5]. On our discussion of shipping Hadoop > 2.6 > >> > >>> binaries, one of your PMC members mentioned that with continued > work > >> on > >> > >> the > >> > >>> 2.7 line y'all weren't planning any additional releases of the > >> earlier > >> > >>> minor versions[6]. > >> > >>> > >> > >>> The HBase community requests that Hadoop pick up making > bug-fix-only > >> > >> patch > >> > >>> releases again on a regular schedule[7]. Preferably on the 2.6 > line > >> and > >> > >>> preferably monthly. We realize that given the time gap since > 2.6.0 it > >> > >> will > >> > >>> likely take a big to get 2.6.1 together, but after that it shoul= d > >> take > >> > >> much > >> > >>> less effort to continue. > >> > >>> > >> > >>> [1]: http://hbase.apache.org/book.html#hadoop > >> > >>> [2]: http://s.apache.org/ReP > >> > >>> [3]: HBASE-13339 > >> > >>> [4]: HADOOP-11674 and HADOOP-11710 > >> > >>> [5]: http://hadoop.apache.org/releases.html > >> > >>> [6]: http://s.apache.org/MTY > >> > >>> [7]: http://s.apache.org/ViP > >> > >>> > >> > >>> -- > >> > >>> Sean > >> > >> > >> > > >> > > >> > >> > >> -- > >> Karthik Kambatla > >> Software Engineer, Cloudera Inc. > >> -------------------------------------------- > >> http://five.sentenc.es > >> > > > > > > > > -- > > Sean > --047d7bd752e494ed4b051af20680--