spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thomas Graves (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-27024) Design executor interface to support GPU resources
Date Fri, 01 Mar 2019 14:43:00 GMT

    [ https://issues.apache.org/jira/browse/SPARK-27024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16781734#comment-16781734
] 

Thomas Graves commented on SPARK-27024:
---------------------------------------

I will be looking at this and propose a design.

> Design executor interface to support GPU resources
> --------------------------------------------------
>
>                 Key: SPARK-27024
>                 URL: https://issues.apache.org/jira/browse/SPARK-27024
>             Project: Spark
>          Issue Type: Task
>          Components: Spark Core
>    Affects Versions: 3.0.0
>            Reporter: Xingbo Jiang
>            Priority: Major
>
> The executor interface shall deal with the resources allocated to the executor by cluster
managers(Standalone, YARN, Kubernetes), so the Spark Executor don’t need to involve into
the GPU discovery and allocation, which shall be handled by cluster managers. However, an
executor need to sync with the driver to expose available resources to support task scheduling.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message