Return-Path: X-Original-To: apmail-incubator-general-archive@www.apache.org Delivered-To: apmail-incubator-general-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 9A7E2118D1 for ; Tue, 24 Jun 2014 06:40:17 +0000 (UTC) Received: (qmail 82512 invoked by uid 500); 24 Jun 2014 06:40:16 -0000 Delivered-To: apmail-incubator-general-archive@incubator.apache.org Received: (qmail 82331 invoked by uid 500); 24 Jun 2014 06:40:16 -0000 Mailing-List: contact general-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: general@incubator.apache.org Delivered-To: mailing list general@incubator.apache.org Received: (qmail 82318 invoked by uid 99); 24 Jun 2014 06:40:16 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 24 Jun 2014 06:40:16 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=5.0 tests=RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: local policy includes SPF record at spf.trusted-forwarder.org) Received: from [76.96.27.227] (HELO qmta12.emeryville.ca.mail.comcast.net) (76.96.27.227) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 24 Jun 2014 06:40:09 +0000 Received: from omta19.emeryville.ca.mail.comcast.net ([76.96.30.76]) by qmta12.emeryville.ca.mail.comcast.net with comcast id J6fB1o0011eYJf8016fpBt; Tue, 24 Jun 2014 06:39:49 +0000 Received: from fs ([24.130.135.131]) by omta19.emeryville.ca.mail.comcast.net with comcast id J6fo1o0052qGB60016fovc; Tue, 24 Jun 2014 06:39:48 +0000 Received: from localhost (tpx.boudnik.org [192.168.102.148]) by fs (8.14.3/8.14.3/Debian-5+lenny1) with ESMTP id s5O6dkhw027182; Mon, 23 Jun 2014 23:39:47 -0700 Date: Mon, 23 Jun 2014 23:39:46 -0700 From: Konstantin Boudnik To: general@incubator.apache.org Cc: dev@tez.incubator.apache.org Subject: Re: Tez graduation [Was: Request for mentor assessment] Message-ID: <20140624063946.GE3686@tpx> References: <7778B9B0-8FD6-4ED2-8BC1-66C4898B5870@apache.org> <7ECDF368-5CBD-40C8-A560-5CB95ABA1B13@apache.org> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="BI5RvnYi6R4T2M87" Content-Disposition: inline In-Reply-To: X-Organization: It's something of 'Cos X-PGP-Key: http://www.boudnik.org/~cos/pubkey.asc User-Agent: Mutt/1.5.21 (2010-09-15) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=comcast.net; s=q20140121; t=1403591989; bh=iHV8qU1Bdua2WW3QGHU7wj1q9k/O06a4q2FPCKM5Yo0=; h=Received:Received:Received:Date:From:To:Subject:Message-ID: MIME-Version:Content-Type; b=DDeab8y9yNX95g/1auWeN71zlZgYyM5MTl/s7h0kquxtQaBObUDgZ8BI3sHNxgalq 7OprLaFjDJ+vT5PPQgCOHpnKyW7Jzt1ARGK528lMvnMhLpzlHYVztQq5j4fXD7kHu8 57E2/um8d0T3jI1j95NjRkYcpTmyAVQEYMcvKgApzEA9CXokpQq9q+OJJOQfg4IhAl yiv3MX67Op5bn+kmaZS3YvEbvpA6yqhk9cqV7Kyg6PwknV8VBcEXGWubP/KxAySaby 2zuLp43Lqy50YrTJZAlkDCFbDlODz5w9Q/4gDswbWQDzdVmiR2Xau0wiPOUb6ESeS0 MLdAB9Zc6l9Jw== X-Virus-Checked: Checked by ClamAV on apache.org --BI5RvnYi6R4T2M87 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable If I am not mistaken, no one really doubt the possible value of Tez (incubating) for other open- and close-source projects. I don't think it is an intention of the IPMC or a wider incubator community to pass the judgement on the technical viability of a project. What is discussed, on the other hand, is how successful said PPMC in achiev= ing the goal of community building and diversification. The link to the project XML was very helpful in understanding the amount of the people involved into the day-to-day activities. And it's great! However, the question that remains unanswered so far - unless I've missed the answer - about the spread of the PPMC and committers? What is the chances of the project staying alive and vibrant if a commercial entity will decide to cease its participation in the project? Regards, Cos On Mon, Jun 23, 2014 at 10:51PM, Rohini Palaniswamy wrote: > I will add my two cents in here on the diversity front as a member of the > Pig team which has been working closely with Tez team for the past 3 > quarters. >=20 > There has been a whole lot of features and design changes done in Tez > driven by requirements from Pig and it has been a pleasure working with t= he > Tez community. We have had a really good collaboration and development has > happened at a really really fast pace both in Pig and Tez, with Pig team > picking features from Tez snapshot builds as and when they are fixed. We > just merged Pig on Tez branch into Pig trunk last month. Most of the > collaboration has been through jiras and you can see a lot of linked Pig > jiras. Pig on Tez is especially a cross-company team effort in Apache - > Yahoo!, Hortonworks, Netflix and LinkedIn and many of the requirements and > fixes on Tez has been driven by the security, performance and large scale > needs of these companies. http://tinyurl.com/m5tbzxt is the list of Tez > jiras created just by the Pig team (48 jiras). There were at least quite a > few more created by others when we reported issues in mails. >=20 > Hive of course is the other big project and Cascading is also into the m= ix > now. With all the widely adopted analytics tools on top of Hadoop adding > support for it and many companies adopting it there is very good future f= or > Tez and I think it is just prejudice to call it as a commercial developme= nt > masquerading as an Apache community. We really see it as a replacement for > mapreduce in the near term and pleased with the current results and the > future potential as a user and have been investing in the development of > Tez as well with dedicated resources. We opened Pig and Hive on Tez for > testing for users in Yahoo! in Apr and Cheolsoo opened up Pig on Tez for > users in Netflix this month and both Netflix and Y! have plans to get it > into production by end of the year and Linkedin also hopes to do the same. > With this early adoption from some of the biggest users of hadoop, I am > sure Tez will only become more stable and mature in the coming year and > gain more traction and wider adoption with other users as well as more > companies migrate to Hadoop 2. >=20 > Regards, > Rohini >=20 >=20 > On Mon, Jun 23, 2014 at 9:48 PM, Roman Shaposhnik wrote: >=20 > > On Mon, Jun 23, 2014 at 9:44 PM, Vinod Kumar Vavilapalli > > wrote: > > > I see two threads here > > > - Concerns about graduation of Apache Tez project w.r.t diversity ba= sed > > on the PPMC html page > > > - Community related threads about things like whether diversity is a > > hard requirement or how > > > to grow communities. > > > > > > AFAICT, Hitesh's latest information on the state of the members of the > > team > > > (and the updated page) should allay any concerns on diversity. > > > > > > If people disagree, we can continue this thread along that discussion. > > If not, we can close this topic as the graduation discussion/vote proce= eds > > here and elsewhere. > > > > > > The other threads may be valuable but OT IMHO and so are better forked > > into their own threads. > > > > I personally think both are very closely related. Like I said, to > > me the diversity thread is really in support of the thesis that > > the project is capable of growing a community outside of > > a forcing function of a single employer. > > > > That said, I haven't done the due diligence to form my personal > > opinion one way or another. I am going to do it this week. > > > > Thanks, > > Roman. > > --BI5RvnYi6R4T2M87 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: Digital signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iF4EAREIAAYFAlOpHTIACgkQenyFlstYjhK6fQD+KlHAJHIdC8VJaobm9pHAvBC0 Rhm+ow/dE3xRUTLGLtwA/AkgZ1M+OPg9MyFXUtzDxLYozR5BqCF3cbxmqD1QXLgc =H1LX -----END PGP SIGNATURE----- --BI5RvnYi6R4T2M87--