From issues-return-192561-archive-asf-public=cust-asf.ponee.io@hive.apache.org Mon Jun 8 00:25:05 2020 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [207.244.88.153]) by mx-eu-01.ponee.io (Postfix) with SMTP id 1949F180675 for ; Mon, 8 Jun 2020 02:25:04 +0200 (CEST) Received: (qmail 29020 invoked by uid 500); 8 Jun 2020 00:25:04 -0000 Mailing-List: contact issues-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list issues@hive.apache.org Received: (qmail 28935 invoked by uid 99); 8 Jun 2020 00:25:03 -0000 Received: from mailrelay1-us-west.apache.org (HELO mailrelay1-us-west.apache.org) (209.188.14.139) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 08 Jun 2020 00:25:03 +0000 Received: from jira-he-de.apache.org (static.172.67.40.188.clients.your-server.de [188.40.67.172]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id D5AB341775 for ; Mon, 8 Jun 2020 00:25:02 +0000 (UTC) Received: from jira-he-de.apache.org (localhost.localdomain [127.0.0.1]) by jira-he-de.apache.org (ASF Mail Server at jira-he-de.apache.org) with ESMTP id 5E61C7821F2 for ; Mon, 8 Jun 2020 00:25:01 +0000 (UTC) Date: Mon, 8 Jun 2020 00:25:01 +0000 (UTC) From: "ASF GitHub Bot (Jira)" To: issues@hive.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Work logged] (HIVE-22160) Job Configuration Properties Unable to Override hive-site.xml Properties in Master Node MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HIVE-22160?focusedWorklogId=3D= 442506&page=3Dcom.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpa= nel#worklog-442506 ] ASF GitHub Bot logged work on HIVE-22160: ----------------------------------------- Author: ASF GitHub Bot Created on: 08/Jun/20 00:24 Start Date: 08/Jun/20 00:24 Worklog Time Spent: 10m=20 Work Description: github-actions[bot] closed pull request #758: URL: https://github.com/apache/hive/pull/758 =20 ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: users@infra.apache.org Issue Time Tracking ------------------- Worklog Id: (was: 442506) Time Spent: 20m (was: 10m) > Job Configuration Properties Unable to Override hive-site.xml Properties = in Master Node > -------------------------------------------------------------------------= -------------- > > Key: HIVE-22160 > URL: https://issues.apache.org/jira/browse/HIVE-22160 > Project: Hive > Issue Type: Bug > Components: Configuration > Affects Versions: 3.1.2 > Reporter: Haotian Zhang > Assignee: Haotian Zhang > Priority: Major > Labels: pull-request-available > Time Spent: 20m > Remaining Estimate: 0h > > When running on the master node, these two ways of creating HiveConf can = result in different Hive configurations: > {code:java} > HiveConf hiveConf =3D HCatUtil.getHiveConf(job.getConfiguration()); > {code} > the above one referred as Style1, and > {code:java} > HiveConf hiveConf =3D new HiveConf(); > hiveConf.addResource(job.getConfiguration()); > {code} > the above one referred as Style2. If there are properties exist both in h= iveSite and jobConf. For example, in hive-site.xml, we have property=C2=A0 > {noformat} > hive.metastore.uris =3D AAA{noformat} > And if at the same time in jobConf, such as action configurations in Oozi= e's workflow.xml, we have=C2=A0 > {noformat} > hive.metastore.uris =3D BBB{noformat} > Then in Style1, the "hive.metastore.uris" property in hiveConf is "AAA" a= nd in Style2, the property in hiveConf is "BBB". > Here is another example to illustrate this. Suppose in hiveSite, "hive.me= tastore.uris" is AAA and in jobConf it is BBB, when executing the following= code: > {code:java} > HiveConf hiveConf =3D HCatUtil.getHiveConf(job.getConfiguration()); > log.info("the hive metastore uri in hiveconf first is: " + hiveConf.get("= hive.metastore.uris")); > hiveConf =3D HCatUtil.getHiveConf(job.getConfiguration()); > log.info("the hive metastore uri in hiveconf second is: " + hiveConf.get(= "hive.metastore.uris")); > {code} > And the log output is: > {noformat} > the hive metastore uri in hiveconf first is: AAA > the hive metastore uri in hiveconf first is: BBB{noformat} > In all, the jobConf does not got set to the configuration as expected whe= n there's already such a property existed in hive site. This happen only on= the master node but not on task nodes. -- This message was sent by Atlassian Jira (v8.3.4#803005)