hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xuefu Zhang (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-16961) Hive on Spark leaks spark application in case user cancels query and closes session
Date Wed, 05 Jul 2017 17:35:00 GMT

     [ https://issues.apache.org/jira/browse/HIVE-16961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Xuefu Zhang updated HIVE-16961:
-------------------------------
       Resolution: Fixed
    Fix Version/s: 3.0.0
           Status: Resolved  (was: Patch Available)

Committed to master. Thanks to Rui for the review.

> Hive on Spark leaks spark application in case user cancels query and closes session
> -----------------------------------------------------------------------------------
>
>                 Key: HIVE-16961
>                 URL: https://issues.apache.org/jira/browse/HIVE-16961
>             Project: Hive
>          Issue Type: Bug
>          Components: Spark
>    Affects Versions: 1.1.0
>            Reporter: Xuefu Zhang
>            Assignee: Xuefu Zhang
>             Fix For: 3.0.0
>
>         Attachments: HIVE-16961.patch, HIVE-16961.patch
>
>
> It's found that a Spark application is leaked when user cancels query and closes the
session while Hive is waiting for remote driver to connect back. This is found for asynchronous
query execution, but seemingly equally applicable for synchronous submission when session
is abruptly closed. The leaked Spark application that runs Spark driver connects back to Hive
successfully and run for ever (until HS2 restarts), but receives no job submission because
the session is already closed. Ideally, Hive should rejects the connection from the driver
so the driver will exist.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message