Return-Path: X-Original-To: apmail-hive-dev-archive@www.apache.org Delivered-To: apmail-hive-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 340D611AEE for ; Mon, 18 Aug 2014 18:46:19 +0000 (UTC) Received: (qmail 7290 invoked by uid 500); 18 Aug 2014 18:46:18 -0000 Delivered-To: apmail-hive-dev-archive@hive.apache.org Received: (qmail 7213 invoked by uid 500); 18 Aug 2014 18:46:18 -0000 Mailing-List: contact dev-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list dev@hive.apache.org Received: (qmail 7199 invoked by uid 500); 18 Aug 2014 18:46:18 -0000 Delivered-To: apmail-hadoop-hive-dev@hadoop.apache.org Received: (qmail 7196 invoked by uid 99); 18 Aug 2014 18:46:18 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 18 Aug 2014 18:46:18 +0000 Date: Mon, 18 Aug 2014 18:46:18 +0000 (UTC) From: "Brock Noland (JIRA)" To: hive-dev@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HIVE-7606) Design SparkSession, SparkSessionManager [Spark Branch] MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HIVE-7606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14101055#comment-14101055 ] Brock Noland commented on HIVE-7606: ------------------------------------ +1 > Design SparkSession, SparkSessionManager [Spark Branch] > ------------------------------------------------------- > > Key: HIVE-7606 > URL: https://issues.apache.org/jira/browse/HIVE-7606 > Project: Hive > Issue Type: Task > Components: Spark > Reporter: Brock Noland > Assignee: Venki Korukanti > Attachments: HIVE-7606.1-spark.patch, HIVE-7606.2-spark.patch > > > In this JIRA we'll design two interfaces: > * SparkSessionState > * SparkSessionPoolManager > and then once that is agreed upon we'll design two implementations: > * SparkSessionStateImpl > * SparkSessionPoolManagerImpl > the form and function of these will be similar to the Tez equivalents. However, TezSessionState provides some implementation which SparkClient already provides (refreshLocalResources*). Let's keep SparkSessionState lightweight and not remove functionality from SparkClient. The scope of this jira is just to create the shells and basic functionality. The implementations in this jira should be able to: > * Share a SparkSessionImpl across queries > * Defining when a session can be re-used > * Take ownership of SparkContext objects (Note we can only have a single SC until SPARK-2243 is resolved) -- This message was sent by Atlassian JIRA (v6.2#6252)