hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rui Li (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-15860) RemoteSparkJobMonitor may hang when RemoteDriver exits abnormally
Date Thu, 09 Feb 2017 12:01:41 GMT

    [ https://issues.apache.org/jira/browse/HIVE-15860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15859410#comment-15859410
] 

Rui Li commented on HIVE-15860:
-------------------------------

We cannot simply extend the monitor timeout to cover {{JobSubmitted}}, otherwise we'll hit
HIVE-9370 again.

> RemoteSparkJobMonitor may hang when RemoteDriver exits abnormally
> -----------------------------------------------------------------
>
>                 Key: HIVE-15860
>                 URL: https://issues.apache.org/jira/browse/HIVE-15860
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Rui Li
>            Assignee: Rui Li
>
> It happens when RemoteDriver crashes between {{JobStarted}} and {{JobSubmitted}}, e.g.
killed by {{kill -9}}. RemoteSparkJobMonitor will consider the job has started, however it
can't get the job info because it hasn't received the JobId. Then the monitor will loop forever.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message