spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Shixiong Zhu (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (SPARK-20843) Cannot gracefully kill drivers which take longer than 10 seconds to die
Date Sat, 27 May 2017 05:27:04 GMT

     [ https://issues.apache.org/jira/browse/SPARK-20843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Shixiong Zhu resolved SPARK-20843.
----------------------------------
       Resolution: Fixed
         Assignee: Shixiong Zhu
    Fix Version/s: 2.2.0
                   2.1.2

> Cannot gracefully kill drivers which take longer than 10 seconds to die
> -----------------------------------------------------------------------
>
>                 Key: SPARK-20843
>                 URL: https://issues.apache.org/jira/browse/SPARK-20843
>             Project: Spark
>          Issue Type: Bug
>          Components: Spark Core
>    Affects Versions: 2.1.1
>            Reporter: Michael Allman
>            Assignee: Shixiong Zhu
>              Labels: regression
>             Fix For: 2.1.2, 2.2.0
>
>
> Commit https://github.com/apache/spark/commit/1c9a386c6b6812a3931f3fb0004249894a01f657
changed the behavior of driver process termination. Whereas before `Process.destroyForcibly`
was never called, now it is called (on Java VM's supporting that API) if the driver process
does not die within 10 seconds.
> This prevents apps which take longer than 10 seconds to shutdown gracefully from shutting
down gracefully. For example, streaming apps with a large batch duration (say, 30 seconds+)
can take minutes to shutdown.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message