spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ricardo Martinelli de Oliveira (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (SPARK-24534) Add a way to bypass entrypoint.sh script if no spark cmd is passed
Date Tue, 12 Jun 2018 21:10:00 GMT

     [ https://issues.apache.org/jira/browse/SPARK-24534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Ricardo Martinelli de Oliveira updated SPARK-24534:
---------------------------------------------------
    Description: 
As an improvement in the entrypoint.sh script, I'd like to propose spark entrypoint do a passthrough
if driver/executor/init is not the command passed. Currently it raises an error.

To me more specific, I'm talking about these lines:

[https://github.com/apache/spark/blob/master/resource-managers/kubernetes/docker/src/main/dockerfiles/spark/entrypoint.sh#L113-L114]

This allows the openshift-spark image to continue to function as a Spark Standalone component,
with custom configuration support etc.

  was:
As an improvement in the entrypoint.sh script, I'd like to propose spark entrypoint do a passthrough
if driver/executor/init is not the command passed. Currently it raises an error.

To me more specific, I'm talking about these lines:

 

[https://github.com/apache/spark/blob/master/resource-managers/kubernetes/docker/src/main/dockerfiles/spark/entrypoint.sh#L113-L114]

 

This allows the openshift-spark image to continue to function as a Spark Standalone component,
with custom configuration support etc, but double as an OpenShift spark-on-k8s image.


> Add a way to bypass entrypoint.sh script if no spark cmd is passed
> ------------------------------------------------------------------
>
>                 Key: SPARK-24534
>                 URL: https://issues.apache.org/jira/browse/SPARK-24534
>             Project: Spark
>          Issue Type: Improvement
>          Components: Kubernetes
>    Affects Versions: 2.3.0
>            Reporter: Ricardo Martinelli de Oliveira
>            Priority: Minor
>
> As an improvement in the entrypoint.sh script, I'd like to propose spark entrypoint do
a passthrough if driver/executor/init is not the command passed. Currently it raises an error.
> To me more specific, I'm talking about these lines:
> [https://github.com/apache/spark/blob/master/resource-managers/kubernetes/docker/src/main/dockerfiles/spark/entrypoint.sh#L113-L114]
> This allows the openshift-spark image to continue to function as a Spark Standalone component,
with custom configuration support etc.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message