hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aihua Xu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-19878) Hive On Spark support AM shut down when there is no job submit
Date Mon, 09 Jul 2018 18:10:00 GMT

    [ https://issues.apache.org/jira/browse/HIVE-19878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16537343#comment-16537343
] 

Aihua Xu commented on HIVE-19878:
---------------------------------

That's right. Also need to mark "Patch available".

> Hive On Spark support AM shut down when there is no job submit
> --------------------------------------------------------------
>
>                 Key: HIVE-19878
>                 URL: https://issues.apache.org/jira/browse/HIVE-19878
>             Project: Hive
>          Issue Type: New Feature
>          Components: Spark
>            Reporter: Song Jun
>            Assignee: Song Jun
>            Priority: Minor
>         Attachments: HIVE-19878.1.patch
>
>
> the Application Master of Hive on Spark always live on the yarn if the Hive client do
not exit(such as one session in HiveServer2), which will accupy lots of resources, we should
control the AM shut down when there is no more jobs submit.
> Now Tez use the param  ` tez.session.am.dag.submit.timeout.secs` to control the DAGAppMaster
on the yarn to shut down.
> So here Spark need to do this too.
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message