Return-Path: X-Original-To: apmail-spark-dev-archive@minotaur.apache.org Delivered-To: apmail-spark-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 75FEFCB26 for ; Wed, 3 Jul 2013 05:53:34 +0000 (UTC) Received: (qmail 12539 invoked by uid 500); 3 Jul 2013 05:53:34 -0000 Delivered-To: apmail-spark-dev-archive@spark.apache.org Received: (qmail 12480 invoked by uid 500); 3 Jul 2013 05:53:33 -0000 Mailing-List: contact dev-help@spark.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@spark.incubator.apache.org Delivered-To: mailing list dev@spark.incubator.apache.org Received: (qmail 12468 invoked by uid 99); 3 Jul 2013 05:53:32 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 03 Jul 2013 05:53:32 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of matei.zaharia@gmail.com designates 209.85.220.41 as permitted sender) Received: from [209.85.220.41] (HELO mail-pa0-f41.google.com) (209.85.220.41) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 03 Jul 2013 05:53:28 +0000 Received: by mail-pa0-f41.google.com with SMTP id bj3so7186628pad.28 for ; Tue, 02 Jul 2013 22:53:08 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=content-type:mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to:x-mailer; bh=z7l6asCQBfFeEUm4L3oWINy1907ZQL42g9J8W5chfuM=; b=l864gVAgYUu2DnQuDdYhf1+0UYdhGN3m7bjmmQKYO/T4TmekJ1a06xOmYiHVaiKGGc IRDR87vKbBiyTA2TG2Ar5Iq4vvrFmG2B367rNIvwmzfvFR8SWW9kz9rVJHCrRctbRLc7 zpI892FapUg9rK+kGrpx9rNEhokibdsCCVWuLPdGImZ5umdnPjS2VLSBXpPL/I1QNF42 c1xWUVGR0mT5PSrts3Hs0VIPVXEblS8WDe+HvdktgXxydL73SlexIBho8ZV29Wg4Av7K N3caHV/1UYieSTLRlfCrqQSOUD0iYhSlDM18KK8zbcRZ0GqaD2W8RcDwLs6GbDBs576U 6aug== X-Received: by 10.66.37.77 with SMTP id w13mr1000792paj.73.1372830788643; Tue, 02 Jul 2013 22:53:08 -0700 (PDT) Received: from [192.168.1.101] (c-24-7-114-112.hsd1.ca.comcast.net. [24.7.114.112]) by mx.google.com with ESMTPSA id dj5sm30294625pbc.25.2013.07.02.22.53.06 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Tue, 02 Jul 2013 22:53:07 -0700 (PDT) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 6.5 \(1508\)) Subject: Re: Mailing list transition (was Re: Apache Spark podling: Created!) From: Matei Zaharia In-Reply-To: Date: Tue, 2 Jul 2013 22:53:07 -0700 Cc: "dev@spark.incubator.apache.org" , Andy Konwinski , "spark-developers@googlegroups.com" Content-Transfer-Encoding: quoted-printable Message-Id: References: To: "Mattmann, Chris A (398J)" X-Mailer: Apple Mail (2.1508) X-Virus-Checked: Checked by ClamAV on apache.org Hey Chris, given that we'll do this, how do we request a = user@spark.incubator.apache.org list? Matei On Jun 28, 2013, at 7:42 PM, "Mattmann, Chris A (398J)" = wrote: > Hey Matei, >=20 > Yep the below is exactly what I suggested to Andy (per your plan = below). >=20 > And yep I think with the $p.i.a.o namespace the transition is pretty > seamless and doesn't require much from the users. >=20 > Cheers, > Chris >=20 > ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ > Chris Mattmann, Ph.D. > Senior Computer Scientist > NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA > Office: 171-266B, Mailstop: 171-246 > Email: chris.a.mattmann@nasa.gov > WWW: http://sunset.usc.edu/~mattmann/ > ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ > Adjunct Assistant Professor, Computer Science Department > University of Southern California, Los Angeles, CA 90089 USA > ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ >=20 >=20 >=20 >=20 >=20 >=20 > -----Original Message----- > From: Matei Zaharia > Date: Friday, June 28, 2013 5:29 PM > To: > Cc: Andy Konwinski , > "spark-developers@googlegroups.com" = > Subject: Re: Mailing list transition (was Re: Apache Spark podling: > Created!) >=20 >> Hey Chris, >>=20 >> I definitely understand that we need to move to Apache lists, and I = think >> that's fine, but maybe one question -- is it possible to transform = the >> *@spark.incubator.apache.org = lists >> into *@spark.apache.org more seamlessly = when >> we graduate? It's weird to ask users to move twice. If these could >> somehow become aliases that would be ideal. >>=20 >> In any case though, I think we'll have a gradual transition. I'd = first >> move the dev list over, then the user one, and for a while I'd keep = both >> and keep a notice on the Google group. I'm not sure how Google groups >> allow that but there must be a way. >>=20 >> Matei >>=20 >> On Jun 28, 2013, at 4:40 PM, "Mattmann, Chris A (398J)" >> wrote: >>=20 >>=20 >> Hey Reynold, >>=20 >> I hear your pain - trust me I do - but at the same time it doesn't >> make sense to half complete bringing the community over. Mailing list >> conversation (especially user oriented ones) are one of the core >> portions of open source communities at least in my experience. >>=20 >> There are not really many hard requirements here at the ASF -- there >> are social norms and memes and old fuddy duddies like me who share >> those memes and information with people to try and encourage open >> source best practice, while at the same time trying not to disturb >> all the awesomeness going on that you guys are leading. >>=20 >> With that, how many users are we talking about on the user mailing >> list at this point? Can you give me an exact count? >>=20 >> I'm willing to spend the time to get people migrated now. Then, >> migrating later from user@spark.incubator.apache.org to >> user@spark.apache.org >> will be really less of a hassle and a lot less difficult since we >> are really moving from ezmlm to ezmlm. Also with the $podling.i.a.o >> namespace I think even now we can use spark.apache.org (*think*) >> which in turn could cause even less hassle later. In addition, like >> I said, when we graduate to TLP I'll also be happy to contribute >> time towards making the migration as seamless as possible. >>=20 >> Cheers, >> Chris >>=20 >> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ >> Chris Mattmann, Ph.D. >> Senior Computer Scientist >> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA >> Office: 171-266B, Mailstop: 171-246 >> Email: chris.a.mattmann@nasa.gov >> WWW: http://sunset.usc.edu/~mattmann/ >> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ >> Adjunct Assistant Professor, Computer Science Department >> University of Southern California, Los Angeles, CA 90089 USA >> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ >>=20 >>=20 >>=20 >>=20 >>=20 >>=20 >> -----Original Message----- >> From: Reynold Xin >> Reply-To: "dev@spark.incubator.apache.org" >> >> Date: Friday, June 28, 2013 4:08 PM >> To: "dev@spark.incubator.apache.org" >> Cc: Andy Konwinski , >> "spark-developers@googlegroups.com" = >> Subject: Re: Mailing list transition (was Re: Apache Spark podling: >> Created!) >>=20 >> Hi Chris, >>=20 >> There are a lot of user preferences set by them (e.g. individual = emails vs >> batch) that wouldn't work when you just "import". If user list is not = an >> absolute requirement for the incubator, it would make sense to delay >> the migration of user lists until we are graduating to a TLP. >>=20 >>=20 >> On Fri, Jun 28, 2013 at 4:02 PM, Mattmann, Chris A (398J) < >> chris.a.mattmann@jpl.nasa.gov> wrote: >>=20 >> Hi Andy et al., >>=20 >> Why don't we just collect the current subscribers to the Google = Group, >> get them to me, and I'll subscribe them to the ASF new lists? I'm = happy >> to create a user list here at the ASF for the project, and to migrate >> the users. Then all they would have to do is remember to use the new >> email when addressing. A change, yes, I know, but still a minimal = one. >>=20 >> That OK? >>=20 >> Cheers, >> Chris >>=20 >> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ >> Chris Mattmann, Ph.D. >> Senior Computer Scientist >> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA >> Office: 171-266B, Mailstop: 171-246 >> Email: chris.a.mattmann@nasa.gov >> WWW: http://sunset.usc.edu/~mattmann/ >> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ >> Adjunct Assistant Professor, Computer Science Department >> University of Southern California, Los Angeles, CA 90089 USA >> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ >>=20 >>=20 >>=20 >>=20 >>=20 >>=20 >> -----Original Message----- >> From: Andy Konwinski >> Date: Friday, June 28, 2013 2:04 PM >> To: jpluser >> Cc: "dev@spark.incubator.apache.org" = , >> "spark-developers@googlegroups.com" = >> Subject: Re: Mailing list transition (was Re: Apache Spark podling: >> Created!) >>=20 >> + spark-developers@googlegroups.com to loop in those who haven't >> subscribed to dev@spark.i.a.o yet, (also because my emails are = getting >> bounced by Apache's spam filters). >>=20 >> I wanted to respond here in the conversation about the mailing list >> migration that was happening on the email thread called "Re: A wiki = for >> Spark (on Apache infra)"... >>=20 >> Assuming that we Apache requires us to migrate from google groups to >> lists on Apache infra, we might consider waiting to migrating the = users >> list to apache infra until after we graduate to a TLP, so that we = only >> have to migrate it once. >>=20 >>=20 >> Here's why. I assume with each list migration that requires = subscribers >> to do work, we will lose some subscribers. If we ask them to migrate = to >> an incubator user list now and then again to yet a different list = when >>=20 >>=20 >> we >> graduate to a TLP (which we hope to >> do fairly quickly), it seems like we will irritate and lose strictly >> more subscribers. >>=20 >>=20 >> This requirement to migrate infra twice as part of moving to Apache >>=20 >>=20 >> seems >> a bit hard on communities. It also seems like a requirement that will >>=20 >>=20 >> go >> away if the changes you are pushing for to the incubation process = (i.e. >> podling TLPs) actually ever happen. >>=20 >>=20 >> Anyway, I see our options as: >>=20 >>=20 >> 1. Migrate only the dev list now (since this is a smaller core group >>=20 >>=20 >> that >> is more likely to migrate with us) and wait to create an apache users >> list until we graduate and migrate from the users google group then. >>=20 >>=20 >> Con: >> it's confusing to have user and dev >> lists on different infra. >>=20 >> 2. Move the users list now, in which case we go with the migration >>=20 >>=20 >> plan I >> proposed earlier. Con: migrating users list twice =3D more irritating = to >> users. >>=20 >> Andy >>=20 >>=20 >>=20 >>=20 >>=20 >>=20 >>=20 >> On Fri, Jun 28, 2013 at 12:20 PM, Mattmann, Chris A (398J) >> wrote: >>=20 >> Hi Andy, >>=20 >> -----Original Message----- >>=20 >> From: Andy Konwinski >> Reply-To: "dev@spark.incubator.apache.org" >> >> Date: Tuesday, June 25, 2013 10:18 AM >> To: "dev@spark.incubator.apache.org" >> Subject: Re: Apache Spark podling: Created! >>=20 >> This is great. >>=20 >> Quick question about mailing lists: Spark also has a >> spark-users >> google >> group. Can we also get a users@spark.i.a.o mailing list to have >>=20 >>=20 >>=20 >>=20 >> somewhere >> to migrate that group? Do I need to create an infra issue for this? >>=20 >>=20 >>=20 >> OK, cool yeah I think I requested commits and dev as lists earlier, = but >> didn't request a user one. To request a new list, you go here: >>=20 >> https://infra.apache.org/officers/mlreq/incubator >>=20 >>=20 >> Did you request a list yet? Should i? >>=20 >> (BTW sorry about the delay in responding was at a DARPA meeting all >> week >> in >> DC an am just back in California now catching up on everything). >>=20 >>=20 >>=20 >> Also, we should discuss a strategy, and timeline for migrating the >> mailing >> lists over to the new ones. >>=20 >> As far as a strategy, here are the steps I can think of that will = help >> make >> for a smooth transition: >>=20 >> 1. Request users list on apache infra (done) >> 2. Pick a day/time for the switch (how about July 1, assuming >> users@spark.i.a.o is set up by then) >> 3. At Switch time: >> 1. Make announcements on the dev and users mailing lists with >>=20 >>=20 >>=20 >>=20 >> links >> to the new lists, instructions on how to subscribe, and a note >> saying all >> conversations are moving over to that list. >> 2. Update the website with links to the new lists >> 3. Enable an auto responders on those lists with pointers to the >> new >> apache lists >>=20 >>=20 >>=20 >> Perfect! That's correct Andy. >>=20 >> Cheers, >> Chris >>=20 >> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ >> Chris Mattmann, Ph.D. >> Senior Computer Scientist >> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA >> Office: 171-266B, Mailstop: 171-246 >> Email: chris.a.mattmann@nasa.gov >> WWW: http://sunset.usc.edu/~mattmann/ >> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ >> Adjunct Assistant Professor, Computer Science Department >> University of Southern California, Los Angeles, CA 90089 USA >> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ >>=20 >>=20 >>=20 >>=20 >>=20 >> On Fri, Jun 21, 2013 at 5:03 PM, Mattmann, Chris A (398J) < >> chris.a.mattmann@jpl.nasa.gov> wrote: >>=20 >> CC'ing dev@spark.i.a.o: our first email to the dev list! :) >>=20 >> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ >> Chris Mattmann, Ph.D. >> Senior Computer Scientist >> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA >> Office: 171-266B, Mailstop: 171-246 >> Email: chris.a.mattmann@nasa.gov >> WWW: http://sunset.usc.edu/~mattmann/ >> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ >> Adjunct Assistant Professor, Computer Science Department >> University of Southern California, Los Angeles, CA 90089 USA >> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ >>=20 >>=20 >>=20 >>=20 >>=20 >>=20 >> -----Original Message----- >> From: Henry Saputra >> Date: Friday, June 21, 2013 4:51 PM >> To: jpluser >> Cc: Matt Massie , Reynold Xin >> , Matei Zaharia , Ankur Dave >> , Tathagata Das , >>=20 >>=20 >>=20 >>=20 >> Haoyuan >> Li >> , Josh Rosen , >> Shivaram Venkataraman , Mosharaf >>=20 >>=20 >> Chowdhury >> , Charles Reiss >>=20 >>=20 >> , >> Andy Konwinski , Patrick Wendell >> , Imran Rashid , >>=20 >>=20 >> Ryan >> LeCompte , Ravi Pandya >> , >> Ram Sriharsha , Robert Evans >> , Mridul Muralidharan , >> Thomas >> Dudziak , Mark Hamstra >> , Stephen Haberman >> , >> Jason Dai , Shane Huang >>=20 >>=20 >> > , >> Andrew xia , Nick Pentreath >> , Sean McNamara >> , >> "Ramirez, Paul M (398J)" , Roman >> Shaposhnik >> , Suresh Marru , "Hart, Andrew F >> (398J)" >> Subject: Re: Apache Spark podling: Created! >>=20 >> Thanks for driving this forward Chris, awesome as usual! =3D) >>=20 >>=20 >> The mailing lists are ready: >> dev@spark.incubator.apache.org >> commits@spark.incubator.apache.org >>=20 >> private@spark.incubator.apache.org >>=20 >>=20 >>=20 >> You can subscribe by sending email to: >> dev-subscribe@spark.incubator.apache.org >> commits-subscribe@spark.incubator.apache.org >> private-subscribe@spark.incubator.apache.org -> This is moderated >>=20 >>=20 >>=20 >>=20 >>=20 >>=20 >> and >> only Sparks' committers, PPMC could subscribe to it. >>=20 >>=20 >> Hopefully we could start communicating using the dev@ list starting >>=20 >>=20 >> next >> week. >>=20 >>=20 >> For those new to ASF, welcome! =3D) >>=20 >>=20 >> Thanks, >>=20 >>=20 >> Henry >>=20 >>=20 >>=20 >>=20 >>=20 >> On Thu, Jun 20, 2013 at 1:41 PM, Mattmann, Chris A (398J) >> wrote: >>=20 >> Hi Everyone, >>=20 >> Just to double check: does everyone have an Apache Individual >> Contributor License Agreement (ICLA) on file? If you don't please >> head over to: >>=20 >> http://www.apache.org/licenses/icla.txt >>=20 >>=20 >> Please fill that out and then submit to >>=20 >>=20 >> secretary@apache.org >>=20 >> I'll make sure that everyone's account gets created and that >> karma for the Git repo is set up based on that, working with >> infra. I or any of the other mentors can help with this too. >>=20 >> Cheers, >> Chris >>=20 >> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ >> Chris Mattmann, Ph.D. >> Senior Computer Scientist >> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA >> Office: 171-266B, Mailstop: 171-246 >> Email: chris.a.mattmann@nasa.gov >> WWW: http://sunset.usc.edu/~mattmann/ >> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ >> Adjunct Assistant Professor, Computer Science Department >> University of Southern California, Los Angeles, CA 90089 USA >> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ >>=20 >>=20 >>=20 >>=20 >>=20 >>=20 >> -----Original Message----- >> From: , jpluser >> Date: Wednesday, June 19, 2013 10:16 PM >> To: jpluser >> Cc: Matt Massie , Reynold Xin >> , Matei Zaharia , Ankur >>=20 >>=20 >> Dave >> , Tathagata Das , >>=20 >>=20 >> Haoyuan >> Li >> , Josh Rosen , >>=20 >>=20 >> Reynold >> Xin , Shivaram Venkataraman >> , Mosharaf Chowdhury >> , Charles Reiss >>=20 >>=20 >>=20 >>=20 >> > , >> Andy Konwinski , Patrick Wendell >> , Imran Rashid , >>=20 >>=20 >> Ryan >> LeCompte , Ravi Pandya >>=20 >>=20 >> > , >> Ram Sriharsha , Robert Evans >> , Mridul Muralidharan , >>=20 >>=20 >> Thomas >> Dudziak , Mark Hamstra >> , Stephen Haberman >>=20 >>=20 >> , >> Jason Dai , Shane Huang >>=20 >>=20 >> , >> Andrew xia , Nick Pentreath >> , Sean McNamara >>=20 >>=20 >> >> Subject: Apache Spark podling: Created! >>=20 >> Hi Everyone, >>=20 >> Until our mailing lists are created, will have to just reply all >> to this list :) >>=20 >> Apache Spark (incubating) now is created! See: >>=20 >> http://s.apache.org/yRh >>=20 >> Yay! Thanks for the support in getting this started! I've gone >> ahead and filed the requisite INFRA tasks: >>=20 >> https://issues.apache.org/jira/browse/INFRA-6417 >>=20 >>=20 >> per: >>=20 >> http://www.apache.org/dev/infra-contact#requesting-podling >>=20 >>=20 >> You can follow the bootstrap process at INFRA-6417, by >> putting yourself on the watch list for the issue. Now >> I'll work with infra@ to get everything set up in terms of >> mailing lists, etc, and then I'd appreciate everyone helping >> in terms of letting folks know to migrate on the existing >> email lists, and helping to work with me to get Git version >> history transferred over, and to start moving the project >> into the ASF. >>=20 >> One other thing, Matei: it would be really nice to do a >> software grant on this: >>=20 >> http://www.apache.org/licenses/software-grant.txt >>=20 >>=20 >> =46rom maybe AMPLab (and anyone else). Can you help take >> the lead in getting that submitted to the Apache Secretary and >> CC me? >>=20 >> Thanks guys! Progress :) >>=20 >> Our first Incubator PMC report is due in July. I'll prod and >> help put it together. Until then, time to start transitioning >> and helping to get the project moved on over. >>=20 >> Cheers, >> Chris >>=20 >>=20 >> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ >> Chris Mattmann, Ph.D. >> Senior Computer Scientist >> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA >> Office: 171-266B, Mailstop: 171-246 >> Email: chris.a.mattmann@nasa.gov >> WWW: http://sunset.usc.edu/~mattmann/ >> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ >> Adjunct Assistant Professor, Computer Science Department >> University of Southern California, Los Angeles, CA 90089 USA >> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ >>=20 >>=20 >>=20 >>=20 >>=20 >>=20 >>=20 >>=20 >>=20 >>=20 >>=20 >>=20 >>=20 >>=20 >>=20 >>=20 >>=20 >>=20 >>=20 >>=20 >>=20 >>=20 >>=20 >>=20 >>=20 >>=20 >>=20 >>=20 >>=20 >>=20 >>=20 >>=20 >>=20 >>=20 >=20