From general-return-66224-archive-asf-public=cust-asf.ponee.io@incubator.apache.org Mon Oct 29 14:13:37 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id D9F35180627 for ; Mon, 29 Oct 2018 14:13:36 +0100 (CET) Received: (qmail 37422 invoked by uid 500); 29 Oct 2018 13:13:30 -0000 Mailing-List: contact general-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: general@incubator.apache.org Delivered-To: mailing list general@incubator.apache.org Received: (qmail 37405 invoked by uid 99); 29 Oct 2018 13:13:29 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 29 Oct 2018 13:13:29 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 56B65C221A for ; Mon, 29 Oct 2018 13:13:29 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -0.103 X-Spam-Level: X-Spam-Status: No, score=-0.103 tagged_above=-999 required=6.31 tests=[DKIMWL_WL_MED=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id l12SoSF1RZGW for ; Mon, 29 Oct 2018 13:13:27 +0000 (UTC) Received: from mail-wr1-f65.google.com (mail-wr1-f65.google.com [209.85.221.65]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 841465F35B for ; Mon, 29 Oct 2018 13:13:27 +0000 (UTC) Received: by mail-wr1-f65.google.com with SMTP id g9-v6so8640897wrq.4 for ; Mon, 29 Oct 2018 06:13:27 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :content-transfer-encoding; bh=DNTdomP1cXK3CrPXvGI2JYVlEbjvFn0QkW+c2U+0F9g=; b=WzLe4k6xB6F8CC8Ws5OQcpZQdZ/cj9qrDnpQ3TknPB/wJdO0xEIa05pN8szItDlFlh 2mXW4q7poi1jPTt4Q8iNifliv/D2ZM0E/+vYGeRtLWgbqTsSF6f3xLou9/Xidmo8LY9C ADzCnge+4FnpAnSvoUEZRc+UX9nw83bECYSgaccRAuQYTB6w4FV1gsazlRuj38ysYzRY ZIWAXKIr+MGe107mRabTbKSZCx9adLU8jkBsJW0kWqAmrnqAVHj+3MWRK+AyvATfR3js cPIF1Ruj0GaTcDmcHhWUpvxOJTDuh7y3bYunGZaGYOK0TfhSUxPwJBC7j8ak5B9ai2oq Qnqg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:content-transfer-encoding; bh=DNTdomP1cXK3CrPXvGI2JYVlEbjvFn0QkW+c2U+0F9g=; b=Eaz9uAAyt3y5KRn0gi2V9qiZIwHl8MoGNHY4d0jKFC2cNwmZ93EId7eNGoynanAxTW CJobonpsvmQ70NWkeuA7a1QKbYnYCnbedasd5tidYmm/yfWZ9McQHP5MIPkCbxq4dfz4 d4NWpsH4iuwz/7itoll/4EYvPNzYnI6XohkubYShnJO5eQacRWJXOsI+7DhAFiBNkLTq VGDrnYsyizc89nsuPTXit8RbuGR4OeBQTkHkWN5/dcOswvHDmTJ8pIdfla+y839huQrf bE1Ul6OUEBiuCwZx3xEM+7b04JJ79GQtkytl5BWHXSxuov1m6oErgTcVXmNy89xlYjZo uxbw== X-Gm-Message-State: AGRZ1gLV+8dFpzHsP0lP/m9YRjoA8sY5lhhgoeS0SN43GBkrjMNdssKe HNg+KwMvnmB4p1WdjXCHjG6Rb3lZxE7IIJRr32Jt60p+ X-Google-Smtp-Source: AJdET5fUvCOcimKfoi+AS+Q7uTsj02AuczG9zKYuTuF8oZiiM1FHKYHsanpXyZ0aQXDgaYq9qYYI2xp8ohMJRRpMyDs= X-Received: by 2002:adf:f712:: with SMTP id r18-v6mr14436158wrp.85.1540818806711; Mon, 29 Oct 2018 06:13:26 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Willem Jiang Date: Mon, 29 Oct 2018 21:13:14 +0800 Message-ID: Subject: Re: [DISCUSS] Sharding-Sphere incubation proposal To: general@incubator.apache.org Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Sharding-Sphere already has a very active community, it's good to see it will be part of Apache incubator. Willem Jiang Twitter: willemjiang Weibo: =E5=A7=9C=E5=AE=81willem On Mon, Oct 29, 2018 at 5:27 PM zhangliang@apache.org wrote: > > Dear Apache Incubator Community, > > I would like to start a discussion about the incubation of Sharding-Spher= e > at Apache. > > Please accept the Sharding-Sphere podling into the Incubator. > > We have 4 mentors, also we are welcome other volunteers to mentor us. > > The proposal can be found at > https://wiki.apache.org/incubator/ShardingSphereProposal . Here is the te= xt > of it: > > > =3D Abstract =3D > Sharding-Sphere is an ecosystem of transparent distributed database > middleware, focusing on data sharding, distributed transaction and databa= se > orchestration. It provides maximum compatibility for applications through > Sharding-JDBC (a driver to implement JDBC) or Sharding-Proxy (a proxy to > implement database protocol). > > =3D Proposal =3D > With a large number of end users, Sharding-Sphere has a fairly huge > community in China. It is also widely adopted by many [[ > http://shardingsphere.io/community/en/company/|companies and > organizations]] as a solution to process their massive amounts of data. > > We believe that bringing Sharding-Sphere into Apache Software Foundation > could advance development of a stronger and more diverse open source > community. > > Dangdang submits this proposal to donate Sharding-Sphere's source codes a= nd > all related documentations to Apache Software Foundation. The codes are > already under Apache License Version 2.0. > > * Code base: https://github.com/sharding-sphere/sharding-sphere > > * Web site: http://shardingsphere.io/ > > * Documentations: http://shardingsphere.io/document/current/ > > * Community: http://shardingsphere.io/community/ > > =3D Background =3D > > Relational database hardly supports such huge amounts of data any more > which has increased rapidly in recent years, but for reason of technique > maturity, developers and DBAs still want to use it to persist core data. > > Sharding-Sphere was open sourced on Github in 2016. At the very beginning= , > Sharding-Sphere is just a JDBC driver for data sharding (name as > Sharding-JDBC) at Dangdang internal framework; now it offers data shardin= g, > distributed transaction and database orchestration. Besides JDBC, proxy t= o > implement MySQL database protocol is also supported at present. > Furthermore, our roadmap includes Proxy for PostgreSQL protocol, Sidecar > model, data repica and elastic data scalability function as well. > > Due to the extension of project, we provide proxy model and sidecar model > in addition to JDBC model. Therefore, we rename it to Sharding-Sphere by = [[ > https://github.com/sharding-sphere/sharding-sphere/issues/788|a public > vote]], which refers to a sharding ecosphere with Sharding-JDBC, > Sharding-Proxy and Sharding Sidecar as its three sub-projects. > > Sharding-JDBC has won the [[http://www.oschina.net/project/top_cn_2016|TO= P > 20 most popular open source projects in China 2016]]. > > =3D Rationale =3D > > Relational database still plays a very important role on current > application system. The maturity of products and surrounding ecosystem, t= he > friendliness of its data query and developers' and DBAs' mastery of it, > cannot be completely replaced with other types of database in the near > future. However, current relational database cannot support cloud native > very well and it is not friendly to distributed system. > > It is the ultimate goal of Sharding-Sphere, which manages the databases > scattering around the system, to make user use distributed databases as > simply as using a single one. > > Without extra cost, Sharding-JDBC directly connects database with Java > application to get the best performance. > > Sharding-Proxy is deployed as a stateless server and supports MySQL > protocol at present. In the paper [[ > https://db.cs.cmu.edu/papers/2016/pavlo-newsql-sigmodrec2016.pdf|What=E2= =80=99s > Really New with NewSQL?]], three types of NewSQL are introduced, among > which Sharding-Proxy is a Transparent Sharding Middleware. > > Sharding-Sidecar can be understood as a data panel in Service Mesh. The > interaction between the application and the database provides a mesh laye= r. > The concept of Database Mesh is similar to Service Mesh, and it focuses o= n > how to connect data access applications to the database. Database Mesh wi= ll > set up a huge grid system between applications and databases. Application= s > and databases need be placed in the grid system. They are all objects > managed by the meshing layer. > > =3D Current Status =3D > =3D=3D Meritocracy =3D=3D > Sharding-Sphere was incubated at Dangdang in 2015 and open sourced on > GitHub in 2016. In 2017, JingDong recognized its value and determined to > sponsor this project. Sharding-Sphere has contributors and users from man= y > companies; we have set up the PMC Team and Committer Team. New contributo= rs > are guided and reviewed by existed PMC members. When they are ready, PMC > will start a vote to promote him/her to become a member of PMC or Committ= er > Team. See the details See the details [[ > http://shardingsphere.io/community/en/organization/|here]]. Contributions > are always welcomed and highly valued. > > =3D=3D Community =3D=3D > Now we have set development teams for Sharding-Sphere respectively in > JingDong, Dangdang and Bestpay. Companies like Sohu and Dataman have show= n > great interest in Sharding-Sphere. We hope to grow the base of contributo= rs > by inviting all those who offer contributions through The Apache Way. Rig= ht > now, we make use of github as code hosting as well as gitter for communit= y > communication. > > =3D=3D Core Developers =3D=3D > The core developers, including experienced open source developers and tea= m > leaders, have formed a group full of diversity. > > =3D Known Risks =3D > =3D=3D Orphaned products =3D=3D > Three development teams from JingDong, Dangdang and CHINA TELECOM Bestpay > will spare no pains to work on Sharding-Sphere in the future with > contributors from the growing community. Also, Sharding-Sphere is widely > adopted in China by many [[ > http://shardingsphere.io/community/en/company/|companies and > organizations]]. Thus, it is very unlikely that Sharding-Sphere becomes > orphaned. > > =3D=3D Inexperience with Open Source =3D=3D > > The current core developers all work for companies that have developed or > contributed to many open source projects. > > * Liang Zhang, PMC. He is the lead of two open source projects, > Sharding-Sphere and Elastic-Job. Also Committer of Apache Dubbo (Incubato= r). > > * Sheng Wu, PMC. He is the PPMC and committer of Apache > SkyWalking(Incubating), Apache Zipkin(Incubating) contributor, CNCF > OpenTracing member. Also contributed a lot other open source projects. > > * Hongtao Gao, PMC. He is the PPMC and committer of Apache > SkyWalking(Incubating) too. Also contribute a lot of features of > Elastic-Job. > > Therefore, we believe we have enough experience to deal with open source. > > =3D=3D Homogenous Developers =3D=3D > The current core developers work across a variety of organizations > including Jingdong, Dangdang and CHINA TELECOM Bestpay; some individual > developers are accepted as core developers of Sharding-Sphere as well. > Considering that Sohu and Dataman have shown great interest in > Sharding-Sphere, we plan to encourage them to contribute and invite them = as > contributors to work together. > > =3D=3D Reliance on Salaried Developers =3D=3D > At present, three of the core developers are paid by their employer to > contribute to Sharding-Sphere project. It is estimated that the developme= nt > of Sharding-Sphere will be continued with mainly salaried developers, and > we will make efforts to attract more volunteers and grow the community. > > =3D=3D Relationships with Other Apache Products =3D=3D > > An automatic prober of Sharding-Sphere is introduced into SkyWalking to > send APM data, and SkyWalking also use Sharding-Sphere to persit tracing > data. Saga provided by ServiceComb is adopted by Sharding-Sphere as one o= f > the distributed transaction processing engines. Sharding-Sphere integrate= s > Apache Zookeeper as one of the service registration/discovery mechanisms. > > =3D=3D A Excessive Fascination with the Apache Brand =3D=3D > We acknowledge the value and reputation that the Apache brand would bring > to Sharding-Sphere. However, our primary interest is in the excellent > community provided by Apache Software Foundation, in which all the projec= ts > could gain stability for long-term development. > > =3D Documentation =3D > A complete set of Sharding-Sphere documentations is provided on > shardingsphere.io in both English and Simplified Chinese. > > * [[http://shardingsphere.io/document/current/en/overview/|English]] > * [[http://shardingsphere.io/document/current/cn/overview/|Chinese]] > > =3D Initial Source =3D > The project consists of three distinct codebases: core, example and > document. The address of three existed git repositories are as follows: > > * https://github.com/sharding-sphere/sharding-sphere > * https://github.com/sharding-sphere/sharding-sphere-example > * https://github.com/sharding-sphere/sharding-sphere-doc > > =3D Source and Intellectual Property Submission Plan =3D > The codes are currently under Apache License Version 2.0 and have been > verified to have no intellectual property or license issues before being > released to open source by Dangdang in 2016. Dangdang will provide SGA an= d > all committers will sign ICLA after Sharding-Sphere is accepted into the > Incubator. > > =3D External Dependencies =3D > > As all dependencies are managed using Apache Maven, none of the external > libraries need to be packaged in a source distribution. All dependencies > have Apache compatible licenses except MySQL (GPL-2.0). > > We will remove MySQL dependencies in future. MySQL JDBC driver is adopted > by Sharding-Proxy to connect MySQL now; We will use SPI to load JDBC > driver, so MySQL JDBC driver is no longer provided on Sharding-Sphere. > > * Guava Apache-2.0 > * Guava Retrying Apache-2.0 > * commons-codec Apache-2.0 > * commons-pool Apache-2.0 > * commons-dbcp Apache-2.0 > * netty Apache-2.0 > * curator Apache-2.0 > * grpc Apache-2.0 > * protobuf BSD 3-clause > * lombok MIT > * groovy Apache-2.0 > * snakeyaml Apache-2.0 > * spring-context-support Apache-2.0 > * spring-context-test Apache-2.0 > * spring-boot-starter Apache-2.0 > * spring-boot-configuration-processor Apache-2.0 > * spring-boot-starter-test Apache-2.0 > * slf4j MIT > * logback EPL-1.0 > * junit EPL-1.0 > * hamcrest BSD 3-clause > * mockito MIT > * h2 MPL-2.0/EPL-1.0 > * mysql GPL-2.0 Will remove before first apache release, use SPI instea= d > of it > * postgresql BSD > * mssql-jdbc MIT > * HikariCP Apache-2.0 > * ANTLR BSD > * OpenTracing BSD > > =3D Required Resources =3D > =3D=3D Git Repositories =3D=3D > * https://github.com/sharding-sphere/sharding-sphere.git > * https://github.com/sharding-sphere/sharding-sphere-example.git > * https://github.com/sharding-sphere/sharding-sphere-doc.git > > > =3D=3D Issue Tracking =3D=3D > > The community would like to continue using GitHub Issues. > > =3D=3D Continuous Integration tool =3D=3D > Travis > > =3D=3D Mailing Lists =3D=3D > * Sharding-Sphere-dev: for development discussions > * Sharding-Sphere-private: for PPMC discussions > * Sharding-Sphere-notifications: for users notifications, and > notifications from GitHub > > =3D=3D Initial Committers =3D=3D > * =E5=BC=A0=E4=BA=AE, Liang Zhang, zhangliang@apache.org > * =E6=9B=B9=E6=98=8A, Hao Cao, > * =E5=90=B4=E6=99=9F, Sheng Wu, wusheng@apache.org > * =E9=AB=98=E6=B4=AA=E6=B6=9B, Hongtao Gao, hanahmily@apache.org > * =E5=BC=A0=E6=B0=B8=E4=BC=A6, Yonglun Zhang > * =E6=BD=98=E5=A8=9F, Juan Pan > * =E8=B5=B5=E4=BF=8A, Jun Zhao > * =E5=B2=B3=E4=BB=A4, Ling Yue > * =E9=A9=AC=E6=99=93=E5=85=89, Xiaoguang Ma > * =E9=99=88=E6=B8=85=E9=98=B3, QingYang Chen > > =3D=3D Affiliations =3D=3D > * JD: Liang Zhang, Yonglun Zhang, Juan Pan, Jun Zhao > * Dangdang: Hao Cao, Ling Yue > * CHINA TELECOM Bestpay: QingYang Chen > * Individuals: Sheng Wu, Hongtao Gao, Xiaoguang Ma > > =3D Sponsors =3D > =3D=3D Champion =3D=3D > * Roman Shaposhnik (rvs at apache dot org) > > =3D=3D Mentors =3D=3D > * Craig L Russell (clr at apache dot org) > * Benjamin Hindman (benh at apache dot org) > * Willem Ning Jiang (ningjiang at apache dot org) > > =3D=3D Sponsoring Entity =3D=3D > We are expecting the Apache Incubator could sponsor this project. > > > Best Regards, > John(Zhang Liang) from Sharding-Sphere --------------------------------------------------------------------- To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org For additional commands, e-mail: general-help@incubator.apache.org