spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Apache Spark (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-15271) Allow force pulling executor docker images
Date Mon, 25 Jul 2016 20:19:20 GMT

    [ https://issues.apache.org/jira/browse/SPARK-15271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15392588#comment-15392588
] 

Apache Spark commented on SPARK-15271:
--------------------------------------

User 'philipphoffmann' has created a pull request for this issue:
https://github.com/apache/spark/pull/14348

> Allow force pulling executor docker images
> ------------------------------------------
>
>                 Key: SPARK-15271
>                 URL: https://issues.apache.org/jira/browse/SPARK-15271
>             Project: Spark
>          Issue Type: New Feature
>          Components: Mesos
>    Affects Versions: 1.6.1
>            Reporter: Philipp Hoffmann
>            Assignee: Philipp Hoffmann
>             Fix For: 2.1.0
>
>
> Mesos agents by default will not pull docker images which are cached locally already.
> Because of this, in order to run a mutable tag (like {{...:latest}}) from the current
version on the docker repository you have to explicitly tell the Mesos agent to pull the image
(force pull). Otherwise the Mesos agent will run an old (cached version).
> The feature for force pulling the image was introduced in Mesos 0.22:
> https://github.com/apache/mesos/commit/8682569df528717ff5efb64da26b1b49c39c4efd
> This ticket is about making use of this feature in Spark in order to force Mesos agents
to pull the executors docker image.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message