hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "zhihai xu (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HIVE-16456) Kill spark job when InterruptedException happens or driverContext.isShutdown is true.
Date Fri, 14 Apr 2017 21:57:42 GMT
zhihai xu created HIVE-16456:
--------------------------------

             Summary: Kill spark job when InterruptedException happens or driverContext.isShutdown
is true.
                 Key: HIVE-16456
                 URL: https://issues.apache.org/jira/browse/HIVE-16456
             Project: Hive
          Issue Type: Improvement
            Reporter: zhihai xu
            Assignee: zhihai xu
            Priority: Minor


Kill spark job when InterruptedException happens or driverContext.isShutdown is true. If the
InterruptedException happened in RemoteSparkJobMonitor and LocalSparkJobMonitor, it will be
better to kill the job. Also there is a race condition between submit the spark job and query/operation
cancellation, it will be better to check driverContext.isShutdown right after submit the spark
job. This will guarantee the job being killed no matter when shutdown is called. It is similar
as HIVE-15997.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message