airavata-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mangirish Wagle <vaglomangir...@gmail.com>
Subject Re: Need inputs on running MPI jobs on Mesos
Date Fri, 14 Oct 2016 17:31:13 GMT
Hi Joseph,

Thanks for your response.
What I really want to know is, whether there are any particular reasons why
the community has not been supporting any work related to MPI on Mesos.
There has been some good demand for cloud based MPI support. Given the
known resource management capabilities of Mesos, we at Apache Airavata are
targeting a Mesos based schedular for MPI jobs for extending the
capabilities to cloud based clusters and not necessarily HPC/ HTC.

I would be interested to know or contribute to any work towards supporting
MPI on Mesos planned in near future.

Thanks and Regards,
Mangirish

CC: Airavata dev mailing list.

On Fri, Oct 14, 2016 at 12:21 PM, Joseph Wu <joseph@mesosphere.io> wrote:

> Other than test frameworks or frameworks Mesos considers part of its CLI,
> there shouldn't be any other Frameworks that are part of the Mesos
> codebase.  (Imagine shipping Spark or Marathon or a bunch of other
> humongous frameworks along with Mesos.)  Same thing goes for MPI, which may
> or may not even work anymore.  I don't know anyone that has run the MPI
> framework in the past several years.
>
> On Fri, Oct 14, 2016 at 8:51 AM, Mangirish Wagle <vaglomangirish@gmail.com
> >
> wrote:
>
> > Thanks for the response.
> > May I know if there are any reasons for not continuing to develop and
> > support MPI framework? Are there any known issues with running MPI jobs
> on
> > Mesos?
> >
> > Best Regards,
> > Mangirish
> >
> > On Fri, Oct 14, 2016 at 2:20 AM, haosdent <haosdent@gmail.com> wrote:
> >
> > > Refer to https://issues.apache.org/jira/browse/MESOS-6084, I think the
> > MPI
> > > framework would be deprecated.
> > >
> > > On Fri, Oct 14, 2016 at 1:57 PM, Mangirish Wagle <
> > vaglomangirish@gmail.com
> > > >
> > > wrote:
> > >
> > > > Hello Mesos Devs,
> > > >
> > > > I am contributing to Apache Airavata <http://airavata.apache.org/>
> and
> > > > currently working on extending the support for the science gateways
> to
> > > run
> > > > MPI jobs on cloud based Mesos clusters.
> > > >
> > > > I am looking at mpiexec-mesos
> > > > <https://github.com/apache/mesos/tree/master/mpi> and Mesos Hydra
> > > > <https://github.com/mesosphere/mesos-hydra> but I am also interested
> > in
> > > > knowing about any latest work that is being done in this area. In
> > > general,
> > > > I want to seek your advice and thoughts on what is the right tool
> that
> > I
> > > > should use, and the appropriate direction to proceed to achieve the
> > > > objective of running MPI jobs on Mesos.
> > > >
> > > > Thank you.
> > > >
> > > > Regards,
> > > > Mangirish Wagle
> > > > Graduate Student, Indiana University Bloomington.
> > > >
> > >
> > >
> > >
> > > --
> > > Best Regards,
> > > Haosdent Huang
> > >
> >
>

Mime
View raw message