hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Song Jun (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-19878) Hive On Spark support AM shut down when there is no job submit
Date Wed, 13 Jun 2018 08:46:00 GMT

     [ https://issues.apache.org/jira/browse/HIVE-19878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Song Jun updated HIVE-19878:
----------------------------
    Description: 
the Application Master of Hive on Spark always live on the yarn if the Hive client do not
exit(such as one session in HiveServer2), which will accupy lots of resources, we should control
the AM shut down when there is no more jobs submit.

Now Tez use the param  ` tez.session.am.dag.submit.timeout.secs` to control the DAGAppMaster
on the yarn to shut down.

So here Spark need to do this too.

 

  was:
the Application Master of Hive on Spark always live on the yarn, which will accupy lots of
resources, we should control the AM shut down when there is no more jobs submit.

Now Tez use the param  ` tez.session.am.dag.submit.timeout.secs` to control the DAGAppMaster
on the yarn to shut down.

So here Spark need to do this too.

 


> Hive On Spark support AM shut down when there is no job submit
> --------------------------------------------------------------
>
>                 Key: HIVE-19878
>                 URL: https://issues.apache.org/jira/browse/HIVE-19878
>             Project: Hive
>          Issue Type: New Feature
>          Components: Spark
>            Reporter: Song Jun
>            Priority: Minor
>         Attachments: HIVE-19878.patch.1
>
>
> the Application Master of Hive on Spark always live on the yarn if the Hive client do
not exit(such as one session in HiveServer2), which will accupy lots of resources, we should
control the AM shut down when there is no more jobs submit.
> Now Tez use the param  ` tez.session.am.dag.submit.timeout.secs` to control the DAGAppMaster
on the yarn to shut down.
> So here Spark need to do this too.
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message