Return-Path: X-Original-To: apmail-hive-dev-archive@www.apache.org Delivered-To: apmail-hive-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id CCDDC1041B for ; Mon, 1 Dec 2014 21:16:14 +0000 (UTC) Received: (qmail 82336 invoked by uid 500); 1 Dec 2014 21:16:14 -0000 Delivered-To: apmail-hive-dev-archive@hive.apache.org Received: (qmail 82272 invoked by uid 500); 1 Dec 2014 21:16:14 -0000 Mailing-List: contact dev-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list dev@hive.apache.org Received: (qmail 82253 invoked by uid 500); 1 Dec 2014 21:16:13 -0000 Delivered-To: apmail-hadoop-hive-dev@hadoop.apache.org Received: (qmail 82250 invoked by uid 99); 1 Dec 2014 21:16:13 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 01 Dec 2014 21:16:13 +0000 Date: Mon, 1 Dec 2014 21:16:13 +0000 (UTC) From: "Xuefu Zhang (JIRA)" To: hive-dev@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HIVE-8957) Remote spark context needs to clean up itself in case of connection timeout [Spark Branch] MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HIVE-8957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14230473#comment-14230473 ] Xuefu Zhang commented on HIVE-8957: ----------------------------------- [~vanzin], would you mind owning the JIRA for now until you figure out a solution? > Remote spark context needs to clean up itself in case of connection timeout [Spark Branch] > ------------------------------------------------------------------------------------------ > > Key: HIVE-8957 > URL: https://issues.apache.org/jira/browse/HIVE-8957 > Project: Hive > Issue Type: Sub-task > Components: Spark > Reporter: Xuefu Zhang > Assignee: Xuefu Zhang > Attachments: HIVE-8957.1-spark.patch > > > In the current SparkClient implementation (class SparkClientImpl), the constructor does some initialization and in the end waits for the remote driver to connect. In case of timeout, it just throws an exception without cleaning itself. The cleanup is necessary to release system resources. -- This message was sent by Atlassian JIRA (v6.3.4#6332)