spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Marcelo Vanzin (JIRA)" <>
Subject [jira] [Created] (SPARK-22994) Require a single container image for Spark-on-K8S
Date Mon, 08 Jan 2018 20:35:00 GMT
Marcelo Vanzin created SPARK-22994:

             Summary: Require a single container image for Spark-on-K8S
                 Key: SPARK-22994
             Project: Spark
          Issue Type: Improvement
          Components: Kubernetes
    Affects Versions: 2.3.0
            Reporter: Marcelo Vanzin

Current k8s backend requires 3 separate container images to be provided by the user to submit
an app. The 3 images are pretty much the same except for the entry point.

Instead, we should require a single image by default, but still allow the user to override
individual images (e.g. executor) if desired.

This should also make it easier to publish an "official" Spark docker image, and should simplify
things like the {{}} script.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message