hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Marcelo Vanzin (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-8957) Remote spark context needs to clean up itself in case of connection timeout [Spark Branch]
Date Wed, 26 Nov 2014 17:40:12 GMT

    [ https://issues.apache.org/jira/browse/HIVE-8957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14226515#comment-14226515
] 

Marcelo Vanzin commented on HIVE-8957:
--------------------------------------

I think a fix here will be a little more complicated than that. Let me look at the code and
think about it.

> Remote spark context needs to clean up itself in case of connection timeout [Spark Branch]
> ------------------------------------------------------------------------------------------
>
>                 Key: HIVE-8957
>                 URL: https://issues.apache.org/jira/browse/HIVE-8957
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Spark
>            Reporter: Xuefu Zhang
>            Assignee: Xuefu Zhang
>         Attachments: HIVE-8957.1-spark.patch
>
>
> In the current SparkClient implementation (class SparkClientImpl), the constructor does
some initialization and in the end waits for the remote driver to connect. In case of timeout,
it just throws an exception without cleaning itself. The cleanup is necessary to release system
resources.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message