hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hive QA (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-16456) Kill spark job when InterruptedException happens or driverContext.isShutdown is true.
Date Sat, 15 Apr 2017 00:07:41 GMT

    [ https://issues.apache.org/jira/browse/HIVE-16456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15969698#comment-15969698
] 

Hive QA commented on HIVE-16456:
--------------------------------



Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12863512/HIVE-16456.000.patch

{color:red}ERROR:{color} -1 due to no test(s) being added or modified.

{color:red}ERROR:{color} -1 due to 3 failed/errored test(s), 10578 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[vector_order_null] (batchId=27)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[columnstats_part_coltype]
(batchId=155)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[vector_if_expr] (batchId=143)
{noformat}

Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/4701/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/4701/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-4701/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 3 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12863512 - PreCommit-HIVE-Build

> Kill spark job when InterruptedException happens or driverContext.isShutdown is true.
> -------------------------------------------------------------------------------------
>
>                 Key: HIVE-16456
>                 URL: https://issues.apache.org/jira/browse/HIVE-16456
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: zhihai xu
>            Assignee: zhihai xu
>            Priority: Minor
>         Attachments: HIVE-16456.000.patch
>
>
> Kill spark job when InterruptedException happens or driverContext.isShutdown is true.
If the InterruptedException happened in RemoteSparkJobMonitor and LocalSparkJobMonitor, it
will be better to kill the job. Also there is a race condition between submit the spark job
and query/operation cancellation, it will be better to check driverContext.isShutdown right
after submit the spark job. This will guarantee the job being killed no matter when shutdown
is called. It is similar as HIVE-15997.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message