hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chengxiang Li (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-9395) Make WAIT_SUBMISSION_TIMEOUT configuable and check timeout in SparkJobMonitor level.[Spark Branch]
Date Mon, 19 Jan 2015 13:49:34 GMT

    [ https://issues.apache.org/jira/browse/HIVE-9395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14282510#comment-14282510
] 

Chengxiang Li commented on HIVE-9395:
-------------------------------------

SparkJobMonitor would hang in some case, like jobId is available(so never timeout in SparkJobStatus)
and SparkJobInfo is null. The risk here is that, we loop in SparkJobMonitor and timeout in
SparkJobStatus which would add unnecessary complexity. we can add interface for SparkJobStatus
if we indeed need more information from it.

> Make WAIT_SUBMISSION_TIMEOUT configuable and check timeout in SparkJobMonitor level.[Spark
Branch]
> --------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-9395
>                 URL: https://issues.apache.org/jira/browse/HIVE-9395
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Spark
>            Reporter: Chengxiang Li
>            Assignee: Chengxiang Li
>              Labels: Spark-M5
>         Attachments: HIVE-9395.1-spark.patch
>
>
> SparkJobMonitor may hang if job state return null all the times, we should move the timeout
check here to avoid it.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message