mesos-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From David Greenberg <dsg123456...@gmail.com>
Subject Re: Does Mesos 1.0 support GPU ?
Date Tue, 23 Aug 2016 01:41:00 GMT
I've run the GPU support with the compiled packages from mesosphere. Here's
a little demo repo that will set things up on an NVIDIA node on AWS:
https://github.com/dgrnbrg/mesos-gpu-docker

Thanks to Kevin Klues for pointing me in the right direction!

On Mon, Aug 22, 2016 at 8:17 PM <jef_chiu@tsmc.com> wrote:

> Hi , yes, it seems that NV GPU already supported by Mesos 1.0. I am not
> sure is there any difference between install Mesos 1.0 from RPM and build
> from source code . Should we build from source code when we need NV GPU
> support feature in Mesos 1.0 ?
>
> Warm regards,
>
> Jef Chiu 邱征輝
> TCCD/ICSD/IT
> Taiwan Semiconductor Manufacturing Company
>
>
>
> |------------------------------------->
> |            Sam                      |
> |            <usultrared@gmail.com>   |
> |                                     |
> |                                     |
> |                                     |
> |            2016/08/23 上午 08:51    |
> |                                     |
> |                                     |
> |                                     |
> |                Please respond to    |
> |              user@mesos.apache.org  |
> |                                     |
> |------------------------------------->
>
> >-------------------------------------------------------------------------------------------------------------------------------|
>   |
>                                                        |
>   |
>                                                        |
>   |
>                                                      To|
>   |        user@mesos.apache.org
>                                                         |
>   |
>                                                      cc|
>   |        jhchenj@tsmc.com, seven_hsieh@tsmc.com
>                                                          |
>   |
>                                                 Subject|
>   |        Re: Does Mesos 1.0 support  GPU ?
>                                                         |
>   |
>                                                        |
>   |
>                                                        |
>   |
>                                                        |
>   |
>                                                        |
>   |
>                                                        |
>
> >-------------------------------------------------------------------------------------------------------------------------------|
>
>
>
>
> Jef,
> I think so. Please check release note
>
> http://finance.yahoo.com/news/apache-software-foundation-announces-apache-100000615.html?from=timeline&isappinstalled=0
>
> Regards,
> Sam
>
> Sent from my iPhone
>
> On Aug 23, 2016, at 8:42 AM, jef_chiu@tsmc.com wrote:
>
>
>       Hi , how could I found GPU resource in Mesos 1.0 ? it seems that the
>       Mesos
>       1.0 already support GPU . But when I follow the
>       https://open.mesosphere.com/getting-started/install/  and install
>       those
>       RPMs in our servers. It seems that it just found CPU/Memory/Disk
>       resource.
>       But  GPU can';t be found by Mesos 1.0 master.
>
>       The following is logs when I startup Mesos 1.0 agent (GPU installed)
>       with
>       command "systemctl start mesos-slave .  I can see the it found GPU in
>       agent
>       log . But Mesos master  can't display GPU .
>
>       Log when start up mesos agent  by "systemctl start mesos-slave "
>       .....
>       I0818 08:58:51.993185 103239 slave.cpp:519] Agent resources: gpus
>       (*):[0-1];
>       cpus(*):48; mem(*):772718; disk(*):145941; ports(*):[31000-32000]
>       I0818 08:58:51.993273 103239 slave.cpp:527] Agent attributes: [  ]
>       .....
>
>       Log when start by command :  mesos-agent --master=10.101.1.22:5050
>       --work_dir=/var/lib/mesos  --resources=gpus:2
>       WARNING: Logging before InitGoogleLogging() is written to STDERR
>       I0823 08:30:57.292623 136165 main.cpp:243] Build: 2016-07-27 20:21:03
>       by
>       centos
>       I0823 08:30:57.292881 136165 main.cpp:244] Version: 1.0.0
>       I0823 08:30:57.292901 136165 main.cpp:247] Git tag: 1.0.0
>       I0823 08:30:57.292914 136165 main.cpp:251] Git SHA:
>       c9b70582e9fccab8f6863b0bd3a812b5969a8c24
>       I0823 08:30:57.303582 136165 systemd.cpp:237] systemd version `219`
>       detected
>       I0823 08:30:57.303639 136165 main.cpp:342] Inializing systemd state
>       I0823 08:30:57.326640 136165 systemd.cpp:325] Started systemd slice
>       `mesos_executors.slice`
>       Failed to create a containerizer: Failed to
>       NvidiaGpuAllocator::create:
>       Failed to nvml::deviceGetHandleByIndex: NVML has not been initialized
>
>
>       I am sure that  GPU function  work normal on that host.  BTW, when I
>       using
>       Mesos 0.28 (package build from source code)  agent and connect with
>       Mesos
>       1.0 master. Mesos master  could report GPU status but can't dispatch
>       job on
>       those nodes.
>
>       Please advise what could I do to  manage GPU resource in Mesos 1.0 ?
>       Thank
>       you .
>
>
>       Warm regards,
>
>       Jef Chiu 邱征輝
>       TCCD/ICSD/IT
>       Taiwan Semiconductor Manufacturing Company
>
>
> ---------------------------------------------------------------------------
>
>                                                               TSMC PROPERTY
>
>       This email communication (and any attachments) is proprietary
>       information
>       for the sole use of its
>
>       intended recipient. Any unauthorized review, use or distribution by
>       anyone
>       other than the intended
>
>       recipient is strictly prohibited.  If you are not the intended
>       recipient,
>       please notify the sender by
>
>       replying to this email, and then delete this email and any copies of
>       it
>       immediately. Thank you.
>
>
> ---------------------------------------------------------------------------
>
>
>
>
>
>  ---------------------------------------------------------------------------
>                                                          TSMC PROPERTY
>  This email communication (and any attachments) is proprietary information
>  for the sole use of its
>  intended recipient. Any unauthorized review, use or distribution by anyone
>  other than the intended
>  recipient is strictly prohibited.  If you are not the intended recipient,
>  please notify the sender by
>  replying to this email, and then delete this email and any copies of it
>  immediately. Thank you.
>
>  ---------------------------------------------------------------------------
>
>

Mime
View raw message