hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From zhankun tang <tangzhan...@gmail.com>
Subject Re: [VOTE] Moving Submarine to a separate Apache project proposal
Date Tue, 03 Sep 2019 06:28:44 GMT
+1

Thanks for Wangda's proposal.

The submarine project is born within Hadoop, but not limited to Hadoop. It
began with a trainer on YARN but it quickly realized that only a trainer is
not enough to meet the AI platform requirements. But now there's no
user-friendly open-source solution covers the whole AI pipeline like data
engineering, training, and serving. And the underlying data infrastructure
itself is also evolving, for instance, many people love k8s. Not mentioning
there're many AI domain problems in this area to be solved.
It's almost for sure that building such an ML platform would utilize
various other open-source components taking ML into consideration initially.

I see submarine grows rapidly towards an enterprise-grade ML platform which
could potentially enable AI ability for data engineer and scientist. This
is an exciting thing for both the community and the industry.

BR,
Zhankun


On Tue, 3 Sep 2019 at 13:34, Xun Liu <liuxun@apache.org> wrote:

> +1
>
> Hello everyone, I am a member of the submarine development team.
> I have been contributing to submarine for more than a year.
> I have seen the progress of submarine development very fast.
> In more than a year, there are 9 long-term developers of different
> companies. Contributing,
> submarine cumulative code has more than 200,000 lines of code, is growing
> very fast,
> and is used in the production environment of multiple companies.
>
> In the submarine development group, there are 5 PMCs and 7committer members
> from Hadoop, spark, zeppelin projects.
> They are very familiar with the development process and specifications of
> the apache community,
> and can well grasp the project development progress and project quality.
> So I recommend submarine to be a TLP project directly.
>
> We will continue to contribute to the submarine project. :-)
>
> Xun Liu
> Regards
>
> On Tue, 3 Sep 2019 at 12:01, Devaraj K <devaraj@apache.org> wrote:
>
> > +1
> >
> > Thanks Wangda for the proposal.
> > I would like to participate in this project, Please add me also to the
> > project.
> >
> > Regards
> > Devaraj K
> >
> > On Mon, Sep 2, 2019 at 8:50 PM zac yuan <yuan.zac.zq@gmail.com> wrote:
> >
> > > +1
> > >
> > > Submarine will be a complete solution for AI service development.  It
> can
> > > take advantage of two best cluster systems: yarn and k8s, which will
> help
> > > more and more people get AI ability. To be a separate Apache project,
> > will
> > > accelerate the procedure of development apparently.
> > >
> > > Look forward to a big success in submarine project~
> > >
> > > 朱林浩 <zhulinhao306@163.com> 于2019年9月3日周二 上午10:38写道:
> > >
> > > > +1,
> > > > Hopefully, that will become the top project,
> > > >
> > > > I also hope to make more contributions to this project.
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > > At 2019-09-03 09:26:53, "Naganarasimha Garla" <
> > > naganarasimha_gr@apache.org>
> > > > wrote:
> > > > >+ 1,
> > > > >    I would also like start participate in this project, hope to get
> > > > myself
> > > > >added to the project.
> > > > >
> > > > >Thanks and Regards,
> > > > >+ Naga
> > > > >
> > > > >On Tue, Sep 3, 2019 at 8:35 AM Wangda Tan <wheeleast@gmail.com>
> > wrote:
> > > > >
> > > > >> Hi Sree,
> > > > >>
> > > > >> I put it to the proposal, please let me know what you think:
> > > > >>
> > > > >> The traditional path at Apache would have been to create an
> > incubator
> > > > >> > project, but the code is already being released by Apache
and
> most
> > > of
> > > > the
> > > > >> > developers are familiar with Apache rules and guidelines.
In
> > > > particular,
> > > > >> > the proposed PMC has 2 Apache TLP PMCs and proposed initial
> > > committers
> > > > >> > have 4 Apache TLP PMCs (from 3 different companies). They
will
> > > provide
> > > > >> > oversight and guidance for the developers that are less
> > experienced
> > > in
> > > > >> the
> > > > >> > Apache Way. Therefore, the Submarine project would like
to
> propose
> > > > >> becoming
> > > > >> > a Top Level Project at Apache.
> > > > >> >
> > > > >>
> > > > >> To me, putting to TLP has mostly pros, it is an easier process
> (same
> > > as
> > > > ORC
> > > > >> spin-off from Hive), much less overhead to both dev community
and
> > > Apache
> > > > >> side.
> > > > >>
> > > > >> Thanks,
> > > > >> Wangda
> > > > >>
> > > > >> On Sun, Sep 1, 2019 at 2:04 PM Sree Vaddi <
> sree_at_chess@yahoo.com>
> > > > wrote:
> > > > >>
> > > > >> > +1 to move submarine to separate apache project.
> > > > >> >
> > > > >> > It is not clear in the proposal, if submarine majority voted
to
> > move
> > > > to a
> > > > >> > seperate apache project,
> > > > >> > will it go through the incubation and TLP (top level project)
> > later
> > > ?
> > > > >> > 1. Incubation
> > > > >> > pros and cons
> > > > >> > efforts towards making it a TLP
> > > > >> >
> > > > >> > 2. direct TLP
> > > > >> >
> > > > >> >
> > > > >> > Thank you.
> > > > >> > /Sree
> > > > >> >
> > > > >> >
> > > > >> >
> > > > >> >
> > > > >> > On Saturday, August 31, 2019, 10:19:06 PM PDT, Wangda Tan
<
> > > > >> > wheeleast@gmail.com> wrote:
> > > > >> >
> > > > >> >
> > > > >> > Hi all,
> > > > >> >
> > > > >> > As we discussed in the previous thread [1],
> > > > >> >
> > > > >> > I just moved the spin-off proposal to CWIKI and completed
all
> TODO
> > > > parts.
> > > > >> >
> > > > >> >
> > > > >> >
> > > > >>
> > > >
> > >
> >
> https://cwiki.apache.org/confluence/display/HADOOP/Submarine+Project+Spin-Off+to+TLP+Proposal
> > > > >> >
> > > > >> > If you have interests to learn more about this. Please review
> the
> > > > >> proposal
> > > > >> > let me know if you have any questions/suggestions for the
> > proposal.
> > > > This
> > > > >> > will be sent to board post voting passed. (And please note
that
> > the
> > > > >> > previous voting thread [2] to move Submarine to a separate
> Github
> > > repo
> > > > >> is a
> > > > >> > necessary effort to move Submarine to a separate Apache
project
> > but
> > > > not
> > > > >> > sufficient so I sent two separate voting thread.)
> > > > >> >
> > > > >> > Please let me know if I missed anyone in the proposal, and
reply
> > if
> > > > you'd
> > > > >> > like to be included in the project.
> > > > >> >
> > > > >> > This voting runs for 7 days and will be concluded at Sep
7th, 11
> > PM
> > > > PDT.
> > > > >> >
> > > > >> > Thanks,
> > > > >> > Wangda Tan
> > > > >> >
> > > > >> > [1]
> > > > >> >
> > > > >> >
> > > > >>
> > > >
> > >
> >
> https://lists.apache.org/thread.html/4a2210d567cbc05af92c12aa6283fd09b857ce209d537986ed800029@%3Cyarn-dev.hadoop.apache.org%3E
> > > > >> > [2]
> > > > >> >
> > > > >> >
> > > > >>
> > > >
> > >
> >
> https://lists.apache.org/thread.html/6e94469ca105d5a15dc63903a541bd21c7ef70b8bcff475a16b5ed73@%3Cyarn-dev.hadoop.apache.org%3E
> > > > >> >
> > > > >>
> > > >
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message