hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rui Li (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-17964) HoS: some spark configs doesn't require re-creating a session
Date Thu, 02 Nov 2017 11:55:00 GMT

    [ https://issues.apache.org/jira/browse/HIVE-17964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16235612#comment-16235612
] 

Rui Li commented on HIVE-17964:
-------------------------------

Some examples are:
{noformat}
hive.spark.explain.user
hive.spark.exec.inplace.progress
hive.spark.use.op.stats
hive.spark.dynamic.partition.pruning
hive.spark.use.ts.stats.for.mapjoin
hive.spark.dynamic.partition.pruning.max.data.size
hive.spark.dynamic.partition.pruning.map.join.only
hive.spark.use.groupby.shuffle
{noformat}

> HoS: some spark configs doesn't require re-creating a session
> -------------------------------------------------------------
>
>                 Key: HIVE-17964
>                 URL: https://issues.apache.org/jira/browse/HIVE-17964
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Rui Li
>            Priority: Minor
>
> I guess the {{hive.spark.}} configs were initially intended for the RSC. Therefore when
they're changed, we'll re-create the session for them to take effect. There're some configs
not related to RSC that also start with {{hive.spark.}}. We'd better rename them so that we
don't unnecessarily re-create sessions, which is usually time consuming.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message