Return-Path: X-Original-To: apmail-incubator-general-archive@www.apache.org Delivered-To: apmail-incubator-general-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 49BC91096F for ; Mon, 26 Aug 2013 23:12:01 +0000 (UTC) Received: (qmail 53723 invoked by uid 500); 26 Aug 2013 23:12:00 -0000 Delivered-To: apmail-incubator-general-archive@incubator.apache.org Received: (qmail 53576 invoked by uid 500); 26 Aug 2013 23:12:00 -0000 Mailing-List: contact general-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: general@incubator.apache.org Delivered-To: mailing list general@incubator.apache.org Received: (qmail 53568 invoked by uid 99); 26 Aug 2013 23:12:00 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 26 Aug 2013 23:12:00 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of davelester@berkeley.edu designates 209.85.128.175 as permitted sender) Received: from [209.85.128.175] (HELO mail-ve0-f175.google.com) (209.85.128.175) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 26 Aug 2013 23:11:54 +0000 Received: by mail-ve0-f175.google.com with SMTP id oy10so2528351veb.20 for ; Mon, 26 Aug 2013 16:11:33 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=x-gm-message-state:mime-version:reply-to:in-reply-to:references :date:message-id:subject:from:to:cc:content-type; bh=641X/KBfSDVM5mJdiJU+q80BOTZvg8+yfDyQziJNe3g=; b=NHIOPOZ10ivXa11eblLCiWWyHWxvyTid3Jp1QL+HstazLvfiI43CeX+3c7xRp1nIWO LsLofVId6wipqWnaeAnfSXQkTp8L2dHNQivrJiX6yHlte62ScWT7wnoF8wQHYyhgY8uh Qj6t3HlqAMvwxmAGQ6f7mlallXK7LIF+N2FrBv+SdWmzoOmPGH6YMvFwxmUb3AeFbC/G DEj37rFX5HxnaLZDqHaL1AxUXWE0Xpj8X1RRuFVhdvilSx4UcA6zpgMeGgG5op4d3SZ1 3/pgxkJKR/owD1EaUUl9Lg9iEQyRuYb8q4HWcdAgBnQ2Fw2HjlClpSigAn3mLb/VD2ar W7Zg== X-Gm-Message-State: ALoCoQkwE+JmhL2uzaT07FHuVKyA34UjE2JmTYQm/FdeU1e7d5nDfZ0v3qxHZTzAEFq1GUtOgHic MIME-Version: 1.0 X-Received: by 10.221.51.206 with SMTP id vj14mr17031577vcb.17.1377558693084; Mon, 26 Aug 2013 16:11:33 -0700 (PDT) Reply-To: dave@ischool.berkeley.edu Received: by 10.52.162.36 with HTTP; Mon, 26 Aug 2013 16:11:33 -0700 (PDT) In-Reply-To: References: Date: Mon, 26 Aug 2013 16:11:33 -0700 Message-ID: Subject: Re: [PROPOSAL] Aurora for Incubation From: Dave Lester To: general@incubator.apache.org, jfarrell@apache.org Cc: David C Lester Content-Type: multipart/alternative; boundary=001a113322528f0cd104e4e1e01a X-Virus-Checked: Checked by ClamAV on apache.org --001a113322528f0cd104e4e1e01a Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable Excellent, thank you Jake! I will add your name to the proposal. Dave On Mon, Aug 26, 2013 at 3:47 PM, Jake Farrell wrote: > I would like to volunteer to be a mentor for this project. > > I am the Apache Thrift project chair and I am involved in the Apache > infrastructure group. I have handled releases for Apache Thrift since its > incubation and am very familiar with new project bootstrapping and > coordination. I think that my experiences with back end systems and scali= ng > architectures would be a perfect fit for this project along with my desir= e > to help new comers learn the Apache way. > > Thank you for your consideration > -Jake > > > > > On Mon, Aug 26, 2013 at 6:27 PM, Dave Lester >wrote: > > > Hi All, > > > > We're pleased to share a draft ASF incubation proposal for Aurora, a > > service scheduler used to schedule jobs onto Apache Mesos that we've > > developed at Twitter. Aurora provides all of the primitives necessary t= o > > quickly deploy and scale stateless and fault tolerant services in a > > datacenter. The complete proposal can be found: > > https://wiki.apache.org/incubator/AuroraProposal, and also pasted below= . > > > > In particular, we'd love to add additional mentors to the project. Your > > feedback is appreciated. > > > > Dave > > > > =3D Abstract =3D > > > > Aurora is a service scheduler used to schedule jobs onto Apache Mesos. > > > > =3D Proposal =3D > > > > Aurora is a scheduler that provides all of the primitives necessary to > > quickly deploy and scale stateless and fault tolerant services in a > > datacenter. > > > > Aurora builds on top of Apache Mesos and provides common features that > > allow any site to run large scale production applications. While the > > project is currently used in production at Twitter, we wish to develop = a > > community to increase contributions and see it thrive in the future. > > > > =3D Background =3D > > > > The initial development of Aurora was done at Twitter, and is planned t= o > be > > open sourced. This proposal is for Aurora to join the Apache Incubator. > > > > =3D Rationale =3D > > > > While the Apache Mesos core focuses on distributing individual tasks > across > > nodes in a cluster, typical services consist of dozens or hundreds of > > replicas of tasks. As a service scheduler, Aurora provides the > abstraction > > of a "job" to bundle and manage these tasks. Aurora provides many key > > functionalities centered around a job, including: definition, the conce= pt > > of an instance and the serverset, deployment and scheduling, health > > checking, and introspection. It also allows cross-cutting concerns to b= e > > handled like observability and log collection. > > > > =3D Current Status =3D > > > > =3D=3D Meritocracy =3D=3D > > > > By submitting this incubator proposal, we=92re expressing our intent to > build > > a diverse developer community around Aurora that will conduct itself > > according to The Apache Way and use meritocratic means of accepting > > contributions. Several members of the Aurora team overlap with Apache > > Mesos, which successfully graduated from the Incubator and has embraced= a > > meritocratic model of governance; we plan to follow a similar path > forward > > with Aurora and believe that a synergy between both projects will make > this > > even easier. > > > > =3D=3D Community =3D=3D > > > > Aurora is currently being used internally at Twitter. By open sourcing > the > > project, we hope to extend our contributor base significantly and creat= e > a > > vibrant community around the project. > > > > =3D=3D Core Developers =3D=3D > > > > Aurora is currently being developed by a team of seven engineers at > > Twitter. > > > > =3D=3D Alignment =3D=3D > > > > The ASF is a natural choice to host the Aurora project, given the goal = of > > open sourcing the project and fostering a community to grow and support > the > > software. Additionally, Aurora integrates with Apache Mesos, and Apache > > ZooKeeper for service discovery. > > > > We believe that inclusion within Apache will build stronger ties betwee= n > > these projects, and create further alignment between their goals and > > communities. > > > > =3D Known Risks =3D > > > > =3D=3D Orphaned Products =3D=3D > > > > The core developers plan to continue working full time on the project, > and > > there is very little risk of Aurora being abandoned since it is running > > hundreds of services as part of Twitter=92s infrastructure. Additionall= y, > > members of the Mesos community beyond Twitter have expressed interest i= n > an > > advanced scheduler like Aurora (see =93Interested Parties=94 section); = we > > believe that need will drive some of the community involvement necessar= y > > for the project to incubate successfully. > > > > =3D=3D Inexperience with Open Source =3D=3D > > > > Initial Aurora committers have varying levels of experience using and > > contributing to Open Source projects, however by working with our mento= rs > > and the Apache community we believe we will be able to conduct ourselve= s > in > > accordance with Apache Incubator guidelines. The close relationship > between > > the Aurora team and Apache Mesos means there is an awareness of the > > incubation process and a willingness to embrace The Apache Way. > > > > =3D=3D Homogenous Developers =3D=3D > > > > The initial set of committers are from a single organization, however w= e > > expect that once approved for incubation the project will attract > > contributors from more organizations. We have already had conversations > > with other companies who have expressed an interest in Aurora. > > > > =3D=3D Reliance on Salaried Developers =3D=3D > > > > Initial Aurora committers are salaried developers at Twitter, however > > shortly after open sourcing the code we plan to diversify the project= =92s > > core committers and contributors. > > > > =3D=3D Relationships with Other Apache Products =3D=3D > > > > Initially, Aurora has been developed as a scheduler for Apache Mesos. > > Additionally, it relies on ZooKeeper for service discovery, allowing > > servers to register at a location and clients to subsequently discover > the > > servers. > > > > =3D=3D An Excessive Fascination with the Apache Brand =3D=3D > > > > While we respect the reputation of the Apache brand and have no doubts > that > > it will attract contributors and users, our interest is primarily to gi= ve > > Aurora a solid home as an open source project following an established > > development model. We have also given reasons in the Rationale and > > Alignment sections. > > > > =3D Documentation =3D > > > > This proposal exists online as > > http://wiki.apache.org/incubator/AuroraProposal. Project documentation > > exists and will be released at the same time as an initial code push. > > > > =3D Initial Source =3D > > > > JIRA Aurora (AURORA) > > > > Source and Intellectual Property Submission Plan > > The current codebase is available upon request. > > > > =3D External Dependencies =3D > > > > All Aurora dependencies have Apache compatible licenses, except cron4j > > (LGPL). An alternative library, most likely Quartz (Apache Public Licen= se > > 2.0) will be used prior to an initial code push. > > > > =3D Cryptography =3D > > Not applicable. > > > > =3D Required Resources =3D > > > > =3D=3D Mailing Lists =3D=3D > > > > * aurora-private for private PMC discussions > > * aurora-dev > > * aurora-commits > > * aurora-user > > * aurora-issues > > > > =3D=3D Subversion Directory =3D=3D > > > > We prefer to use Git as our source control system: git:// > > git.apache.org/aurora > > > > =3D=3D Issue Tracking =3D=3D > > > > JIRA Aurora (AURORA) > > > > =3D Initial Committers =3D > > > > * William Farner (bill at twitter dot com) > > * Brian Wickman (wickman at twitter dot com) > > * Kevin Sweeney (ksweeney at twitter dot com) > > * Sathya Hariesh (sathya at twitter dot com) > > * Jonathan Boulle (jon at twitter dot com) > > * Maxim Khutornenko (mkhutornenko at twitter dot com) > > * Suman Karumuri (skarumuri at twitter dot com) > > * Dave Lester (dlester at twitter dot com) > > > > =3D Affiliations =3D > > > > Twitter > > > > =3D Interested Parties =3D > > > > * Airbnb > > * Foursquare > > * Mesosphere > > > > =3D Sponsors =3D > > > > =3D=3D Champion =3D=3D > > > > Ben Hindman > > > > =3D=3D Nominated Mentors =3D=3D > > > > * Chris Mattmann > > * Ben Hindman > > > > =3D=3D Sponsoring Entity =3D=3D > > Incubator PMC > > > --001a113322528f0cd104e4e1e01a--