hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xuefu Zhang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-17291) Set the number of executors based on config if client does not provide information
Date Mon, 14 Aug 2017 19:37:00 GMT

    [ https://issues.apache.org/jira/browse/HIVE-17291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16126284#comment-16126284
] 

Xuefu Zhang commented on HIVE-17291:
------------------------------------

Did you confirm that the configuration is updated and new session is launched? It might be
possible that the configuration is updated via other code path or the configuration update
is ignored by the test. Every qtest files was executed in a single session in the past and
later this was changed to sharing a session for multiple qtest files. I'm not sure if there
is also some magic.

> Set the number of executors based on config if client does not provide information
> ----------------------------------------------------------------------------------
>
>                 Key: HIVE-17291
>                 URL: https://issues.apache.org/jira/browse/HIVE-17291
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Spark
>    Affects Versions: 3.0.0
>            Reporter: Peter Vary
>            Assignee: Peter Vary
>         Attachments: HIVE-17291.1.patch
>
>
> When calculating the memory and cores and the client does not provide information we
should try to use the one provided by default. This can happen on startup, when {{spark.dynamicAllocation.enabled}}
is not enabled



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message