hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aihua Xu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-14162) Allow disabling of long running job on Hive On Spark On YARN
Date Tue, 15 Nov 2016 16:21:58 GMT

    [ https://issues.apache.org/jira/browse/HIVE-14162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15667558#comment-15667558
] 

Aihua Xu commented on HIVE-14162:
---------------------------------

Thanks Xuefu. There are some cases that the session is still needed. The user runs queries
with different engine, similar to Thomas's example above (switching between HoS and MR). For
this case, HoS is holding the resources. I will take a look at those functions. 

> Allow disabling of long running job on Hive On Spark On YARN
> ------------------------------------------------------------
>
>                 Key: HIVE-14162
>                 URL: https://issues.apache.org/jira/browse/HIVE-14162
>             Project: Hive
>          Issue Type: New Feature
>          Components: Spark
>            Reporter: Thomas Scott
>            Assignee: Aihua Xu
>            Priority: Minor
>         Attachments: HIVE-14162.1.patch
>
>
> Hive On Spark launches a long running process on the first query to handle all queries
for that user session. In some use cases this is not desired, for instance when using Hue
with large intervals between query executions.
> Could we have a property that would cause long running spark jobs to be terminated after
each query execution and started again for the next one?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message