spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sean Owen (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-11402) Allow to define a custom driver runner and executor runner
Date Thu, 29 Oct 2015 23:03:27 GMT

    [ https://issues.apache.org/jira/browse/SPARK-11402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14981530#comment-14981530
] 

Sean Owen commented on SPARK-11402:
-----------------------------------

Yeah, your PR shows an entire new API for this that now has to be maintained and supported.
Why not just write and maintain your own version of these? why must this be pushed into Spark?

> Allow to define a custom driver runner and executor runner
> ----------------------------------------------------------
>
>                 Key: SPARK-11402
>                 URL: https://issues.apache.org/jira/browse/SPARK-11402
>             Project: Spark
>          Issue Type: Improvement
>          Components: Deploy, Spark Core
>            Reporter: Jacek Lewandowski
>            Priority: Minor
>
> {{DriverRunner}} and {{ExecutorRunner}} are used by Spark Worker in standalone mode to
spawn driver and executor processes respectively. When integrating Spark with some environments,
it would be useful to allow providing a custom implementation of those components.
> The idea is simple - provide factory class names for driver and executor runners in Worker
configuration. By default, the current implementations are used. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message