Return-Path: X-Original-To: apmail-hive-dev-archive@www.apache.org Delivered-To: apmail-hive-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 2462A17277 for ; Mon, 19 Jan 2015 13:49:33 +0000 (UTC) Received: (qmail 79690 invoked by uid 500); 19 Jan 2015 13:49:34 -0000 Delivered-To: apmail-hive-dev-archive@hive.apache.org Received: (qmail 79618 invoked by uid 500); 19 Jan 2015 13:49:34 -0000 Mailing-List: contact dev-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list dev@hive.apache.org Received: (qmail 79602 invoked by uid 500); 19 Jan 2015 13:49:34 -0000 Delivered-To: apmail-hadoop-hive-dev@hadoop.apache.org Received: (qmail 79599 invoked by uid 99); 19 Jan 2015 13:49:34 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 19 Jan 2015 13:49:34 +0000 Date: Mon, 19 Jan 2015 13:49:34 +0000 (UTC) From: "Chengxiang Li (JIRA)" To: hive-dev@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HIVE-9395) Make WAIT_SUBMISSION_TIMEOUT configuable and check timeout in SparkJobMonitor level.[Spark Branch] MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HIVE-9395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14282510#comment-14282510 ] Chengxiang Li commented on HIVE-9395: ------------------------------------- SparkJobMonitor would hang in some case, like jobId is available(so never timeout in SparkJobStatus) and SparkJobInfo is null. The risk here is that, we loop in SparkJobMonitor and timeout in SparkJobStatus which would add unnecessary complexity. we can add interface for SparkJobStatus if we indeed need more information from it. > Make WAIT_SUBMISSION_TIMEOUT configuable and check timeout in SparkJobMonitor level.[Spark Branch] > -------------------------------------------------------------------------------------------------- > > Key: HIVE-9395 > URL: https://issues.apache.org/jira/browse/HIVE-9395 > Project: Hive > Issue Type: Sub-task > Components: Spark > Reporter: Chengxiang Li > Assignee: Chengxiang Li > Labels: Spark-M5 > Attachments: HIVE-9395.1-spark.patch > > > SparkJobMonitor may hang if job state return null all the times, we should move the timeout check here to avoid it. -- This message was sent by Atlassian JIRA (v6.3.4#6332)