Return-Path: Delivered-To: apmail-hadoop-general-archive@minotaur.apache.org Received: (qmail 90924 invoked from network); 18 Jan 2011 06:34:23 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 18 Jan 2011 06:34:23 -0000 Received: (qmail 81012 invoked by uid 500); 18 Jan 2011 06:34:22 -0000 Delivered-To: apmail-hadoop-general-archive@hadoop.apache.org Received: (qmail 79384 invoked by uid 500); 18 Jan 2011 06:34:19 -0000 Mailing-List: contact general-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: general@hadoop.apache.org Delivered-To: mailing list general@hadoop.apache.org Received: (qmail 78535 invoked by uid 99); 18 Jan 2011 06:34:19 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 18 Jan 2011 06:34:18 +0000 X-ASF-Spam-Status: No, hits=0.7 required=10.0 tests=LONG_TERM_PRICE,RCVD_IN_DNSWL_NONE,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (nike.apache.org: local policy) Received: from [216.145.54.171] (HELO mrout1.yahoo.com) (216.145.54.171) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 18 Jan 2011 06:34:11 +0000 Received: from SP2-EX07CAS01.ds.corp.yahoo.com (sp2-ex07cas01.corp.sp2.yahoo.com [98.137.59.37]) by mrout1.yahoo.com (8.14.4/8.14.4/y.out) with ESMTP id p0I6XbIv008255 for ; Mon, 17 Jan 2011 22:33:37 -0800 (PST) Received: from [10.0.1.4] (10.72.244.133) by SP2-EX07CAS01.ds.corp.yahoo.com (98.137.59.4) with Microsoft SMTP Server (TLS) id 8.3.106.1; Mon, 17 Jan 2011 22:33:36 -0800 Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 (Apple Message framework v1082) Subject: Re: [DISCUSS] Move project split down a level From: Eric Baldeschwieler In-Reply-To: Date: Mon, 17 Jan 2011 22:33:34 -0800 Content-Transfer-Encoding: quoted-printable Message-ID: <8AA8E042-F3FA-4382-B8AF-1FE272F8A880@yahoo-inc.com> References: <439416.18126.qm@web56207.mail.re3.yahoo.com> <15CB20F8-469A-457D-BFE2-084785FB9E18@mac.com> <113546.32737.qm@web56204.mail.re3.yahoo.com> To: "general@hadoop.apache.org" X-Mailer: Apple Mail (2.1082) X-Virus-Checked: Checked by ClamAV on apache.org Nigel proposes that in this release (as in previous releases), = everything should be packaged together. Our in house experience at yahoo is that this makes a lot of sense. It = is how we find it most effective to operate. The project split has = introduced a lot of complexity with no return. Do you see any advantage to the status quo, versus nigel's proposal? Thanks! And sorry for any ambiguity. E14 On Jan 17, 2011, at 9:54 PM, Konstantin Boudnik wrote: > On Mon, Jan 17, 2011 at 21:40, Eric Baldeschwieler = wrote: >>=20 >> On Jan 17, 2011, at 9:13 PM, Nigel Daley wrote: >>=20 >>>=20 >>> On Jan 14, 2011, at 11:53 AM, Tsz Wo (Nicholas), Sze wrote: >>>>=20 >> ... >>>> Why do we want to enforce the releases as a unit, given that the = long term >>>> target is to release these 3 projects independently? >>>=20 >>> Because that long term view is currently a fantasy with no real end = in sight. >>=20 >> ** +1 to that. We release as a unit, branch as a unit, test as a = unit, deploy as a unit. I've seen no actual gain from the project = split, just complexity. >=20 > Am I missing something in the latest development of Hadoop, Eric? What > do you mean by 'we... test as a unit'? Is it like we have test > artifacts version'd against Hadoop release proper? Or you are trying > to say something else? It isn't very clear, sorry... >=20 > Cos >=20 >=20 >>> Nige >>>=20 >>>=20 >>>> ________________________________ >>>> From: Nigel Daley >>>> To: general@hadoop.apache.org >>>> Sent: Fri, January 14, 2011 11:21:25 AM >>>> Subject: Re: [DISCUSS] Move project split down a level >>>>=20 >>>>=20 >>>> On Jan 14, 2011, at 11:16 AM, Tsz Wo (Nicholas), Sze wrote: >>>>=20 >>>>> Hi Nigel, >>>>>=20 >>>>>> As I look more at the impact of the common/MR/HDFS project split = on what >>>>>> and how we release Hadoop, I feel like the split needs an = adjustment. Many >>>>>> folks I've talked to agree that the project split has caused us a = splitting >>>>>> headache. I think 1 relatively small change could alleviate some = of that. >>>>>=20 >>>>> Could you elaborate your idea on how the proposed changes would = help? What the >>>>>=20 >>>>> problems are being addressed? It is not clear to me. >>>>=20 >>>> Critical in my mind was my statement: "We're a long way from = releasing these 3 >>>> projects independently. Given that, they should be branched and = released as a >>>> unit." This can not be enforced given the current svn layout. = Other's can weigh >>>> in with additional thoughts. >>>>=20 >>>>> You are right that the change is small but the impact is huge. We = should first >>>>>=20 >>>>> understand what we are getting from the changes before doing it. >>>>=20 >>>> What do you see as the huge impact? >>>>=20 >>>> Nige >>>=20 >>=20 >>=20