Return-Path: X-Original-To: apmail-hadoop-general-archive@minotaur.apache.org Delivered-To: apmail-hadoop-general-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 34321DF9D for ; Sat, 1 Sep 2012 00:24:03 +0000 (UTC) Received: (qmail 70085 invoked by uid 500); 1 Sep 2012 00:24:01 -0000 Delivered-To: apmail-hadoop-general-archive@hadoop.apache.org Received: (qmail 69995 invoked by uid 500); 1 Sep 2012 00:24:01 -0000 Mailing-List: contact general-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: general@hadoop.apache.org Delivered-To: mailing list general@hadoop.apache.org Received: (qmail 69985 invoked by uid 99); 1 Sep 2012 00:24:01 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 01 Sep 2012 00:24:01 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (nike.apache.org: local policy) Received: from [209.85.210.48] (HELO mail-pz0-f48.google.com) (209.85.210.48) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 01 Sep 2012 00:23:54 +0000 Received: by dadz8 with SMTP id z8so2798438dad.35 for ; Fri, 31 Aug 2012 17:23:33 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=content-type:mime-version:subject:from:in-reply-to:date :content-transfer-encoding:message-id:references:to:x-mailer :x-gm-message-state; bh=dwUYDmWXjTdx4nt0zOPik5iYY1x1d9EBsRixxNnDMz4=; b=iHGqNKD6bqLdcsMCUSpgnmK0aGrEePZiSWa21BotFckxlhku2nvlJoUvj5eOqG3wJT HVxs41URQPqENdJyRx7OOKMapGG3KZTKLCe340cI4R1PibZaS+Vd0KTeDNzSeK9Cu1xv ie0smo0t8vZCjE1F8oOsSDE/g+WYNMenYorLQf1gMQxDmhdv4ljpDjQStmqLyqM0Ghl0 60BUz0Qi7l+fLuS+IW30qZLyU6UTi3ZtwbDspHUS1f7EKH+8k4cbHzAaSktfnT6aNWjv QyXoh36EwNZ8R74rUiku3HJXf6tzQtuNcZtxkYlnrGvIik1Igw07MmilTp5z7v0b6Nxx rGDw== Received: by 10.68.197.70 with SMTP id is6mr20432398pbc.64.1346459013044; Fri, 31 Aug 2012 17:23:33 -0700 (PDT) Received: from [192.168.100.179] (70-35-59-5.static.wiline.com. [70.35.59.5]) by mx.google.com with ESMTPS id hr9sm4444273pbc.36.2012.08.31.17.23.31 (version=TLSv1/SSLv3 cipher=OTHER); Fri, 31 Aug 2012 17:23:31 -0700 (PDT) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Apple Message framework v1278) Subject: Re: [DISCUSS] Spin out MR, HDFS and YARN as their own TLPs and disband Hadoop umbrella project From: Eric Baldeschwieler In-Reply-To: <0CFE047B-8081-439C-880F-0515EE9382C4@jpl.nasa.gov> Date: Fri, 31 Aug 2012 17:23:30 -0700 Content-Transfer-Encoding: quoted-printable Message-Id: <05FA4100-5571-46AC-ACC2-4E2940FA390A@hortonworks.com> References: <787D4C46-699F-48E9-BFB2-C0C46DD3AE92@jpl.nasa.gov> <0CFE047B-8081-439C-880F-0515EE9382C4@jpl.nasa.gov> To: general@hadoop.apache.org X-Mailer: Apple Mail (2.1278) X-Gm-Message-State: ALoCoQnX50thR3Zxv1UU6T2oD1ivgm3GvYUzVaaEVz7eRckHQyNDt8WeRxvhkmUp9rA52bAEl84x Hi Folks, Lots of good points raised here. I remain convinced that the time to = split Hadoop into TLPs in here, but I think we should also consider the = practical concerns raised. Hadoop 2.0 has been years of work in the making and is finally = relatively close. I think it would be a mistake to throw another = impediment in the way of getting a stable version of 2.0 done, as many = folks have pointed out. So I'd suggest that we plan to do a split once = there is a broad consensus that 2.0 is stable and widely deployed. Perhaps folks interested in planning a split or concerned that a split = might impact them can meet to refine a proposal that we can all consider = implementing once 2.0 is stable. What do folks think? Thanks, E14 On Aug 31, 2012, at 9:08 AM, Mattmann, Chris A (388J) wrote: > Hey Doug, >=20 > On Aug 31, 2012, at 9:00 AM, Doug Cutting wrote: >=20 >> On Fri, Aug 31, 2012 at 8:09 AM, Mattmann, Chris A (388J) >> wrote: >>> I am saying that the current members of the Apache Software = Foundation's Hadoop >>> Project Management Committee exhibit the characteristics (not just = during >>> discrete events; it's been happening for a long time) of folks who = in reality >>> shouldn't belong to the same project management committee. Note: = this is >>> NOT a bad thing. There are probably plenty of (sub-)sets of groups = at Apache >>> and elsewhere that folks wouldn't fit in to. I've enumerated some of >>> those characteristics that you can see sometimes spill over >>> (meta thought discussions about moving things around; or drawing = arbitrary >>> lines around pieces of code that really have nothing to do with = technical >>> stuff, and more to do about insulating and control;), >>=20 >> Hadoop's community is not perfect. But the divisions in the = community >> are not primarily aligned with subcomponent boundaries. A project >> split will thus not likely fix the majority of these community >> imperfections. It may fix some, but ought to be pursued carefully so >> that it doesn't cause more harm than good. >=20 > My own personal opinion of this is that yeah they aren't necessarily > aligned subcomponent boundaries too so +1 agree with you. >=20 >>=20 >>> but there are also other >>> concerns such as frameworks put in to place (exclusivity amongst = others) >>> that themselves are pretty high indicators that this is an umbrella = project. >>=20 >> The partitioning of committers has now been removed in a separate >> vote. Hadoop is not a classic umbrella project. >=20 > Despite me thinking that's a band-aid it's probably at least a good = start. > Let's hope it leads to some better interactions amongst the community > members and to better health overall. >=20 > Cheers, > Chris >=20 > ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ > Chris Mattmann, Ph.D. > Senior Computer Scientist > NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA > Office: 171-266B, Mailstop: 171-246 > Email: chris.a.mattmann@nasa.gov > WWW: http://sunset.usc.edu/~mattmann/ > ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ > Adjunct Assistant Professor, Computer Science Department > University of Southern California, Los Angeles, CA 90089 USA > ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ >=20