spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Apache Spark (JIRA)" <j...@apache.org>
Subject [jira] [Assigned] (SPARK-21834) Incorrect executor request in case of dynamic allocation
Date Mon, 28 Aug 2017 17:28:00 GMT

     [ https://issues.apache.org/jira/browse/SPARK-21834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Apache Spark reassigned SPARK-21834:
------------------------------------

    Assignee:     (was: Apache Spark)

> Incorrect executor request in case of dynamic allocation
> --------------------------------------------------------
>
>                 Key: SPARK-21834
>                 URL: https://issues.apache.org/jira/browse/SPARK-21834
>             Project: Spark
>          Issue Type: Bug
>          Components: Scheduler
>    Affects Versions: 2.2.0
>            Reporter: Sital Kedia
>
> killExecutor api currently does not allow killing an executor without updating the total
number of executors needed. In case of dynamic allocation is turned on and the allocator tries
to kill an executor, the scheduler reduces the total number of executors needed ( see https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala#L635)
which is incorrect because the allocator already takes care of setting the required number
of executors itself. 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message