spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Apache Spark (JIRA)" <j...@apache.org>
Subject [jira] [Assigned] (SPARK-22839) Refactor Kubernetes code for configuring driver/executor pods to use consistent and cleaner abstraction
Date Sun, 25 Feb 2018 00:14:12 GMT

     [ https://issues.apache.org/jira/browse/SPARK-22839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Apache Spark reassigned SPARK-22839:
------------------------------------

    Assignee: Apache Spark

> Refactor Kubernetes code for configuring driver/executor pods to use consistent and cleaner
abstraction
> -------------------------------------------------------------------------------------------------------
>
>                 Key: SPARK-22839
>                 URL: https://issues.apache.org/jira/browse/SPARK-22839
>             Project: Spark
>          Issue Type: Improvement
>          Components: Kubernetes
>    Affects Versions: 2.3.0
>            Reporter: Yinan Li
>            Assignee: Apache Spark
>            Priority: Major
>
> As discussed in https://github.com/apache/spark/pull/19954, the current code for configuring
the driver pod vs the code for configuring the executor pods are not using the same abstraction.
Besides that, the current code leaves a lot to be desired in terms of the level and cleaness
of abstraction. For example, the current code is passing around many pieces of information
around different class hierarchies, which makes code review and maintenance challenging. We
need some thorough refactoring of the current code to achieve better, cleaner, and consistent
abstraction.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message