kudu-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From danburk...@apache.org
Subject kudu git commit: KUDU-2191: bump Hive package
Date Thu, 30 Nov 2017 17:48:19 GMT
Repository: kudu
Updated Branches:
  refs/heads/master 008676061 -> 9e506fcaf


KUDU-2191: bump Hive package

Bumps the packaged Hive version in order to fix a logging bug
(HIVE-16939). Also strips a few more unnecessary jars, and switches to
console logging for the mini HMS.

Change-Id: I4ba17eb76761b2977cd8f643eebb87bcec49034e
Reviewed-on: http://gerrit.cloudera.org:8080/8691
Tested-by: Kudu Jenkins
Reviewed-by: Grant Henke <granthenke@gmail.com>


Project: http://git-wip-us.apache.org/repos/asf/kudu/repo
Commit: http://git-wip-us.apache.org/repos/asf/kudu/commit/9e506fca
Tree: http://git-wip-us.apache.org/repos/asf/kudu/tree/9e506fca
Diff: http://git-wip-us.apache.org/repos/asf/kudu/diff/9e506fca

Branch: refs/heads/master
Commit: 9e506fcafa089859e340a970677267879678373d
Parents: 0086760
Author: Dan Burkert <danburkert@apache.org>
Authored: Wed Nov 29 13:37:33 2017 -0800
Committer: Dan Burkert <danburkert@apache.org>
Committed: Thu Nov 30 17:48:07 2017 +0000

----------------------------------------------------------------------
 src/kudu/hms/mini_hms.cc   | 1 +
 thirdparty/package-hive.sh | 9 +++++----
 thirdparty/vars.sh         | 2 +-
 3 files changed, 7 insertions(+), 5 deletions(-)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/kudu/blob/9e506fca/src/kudu/hms/mini_hms.cc
----------------------------------------------------------------------
diff --git a/src/kudu/hms/mini_hms.cc b/src/kudu/hms/mini_hms.cc
index 8f706f4..68ef4b1 100644
--- a/src/kudu/hms/mini_hms.cc
+++ b/src/kudu/hms/mini_hms.cc
@@ -104,6 +104,7 @@ Status MiniHms::Start() {
       { "HADOOP_HOME", hadoop_home },
       { "HIVE_AUX_JARS_PATH", aux_jars },
       { "HIVE_CONF_DIR", tmp_dir },
+      { "JAVA_TOOL_OPTIONS",  "-Dhive.log.level=WARN -Dhive.root.logger=console" },
   };
 
   // Start the HMS.

http://git-wip-us.apache.org/repos/asf/kudu/blob/9e506fca/thirdparty/package-hive.sh
----------------------------------------------------------------------
diff --git a/thirdparty/package-hive.sh b/thirdparty/package-hive.sh
index e2808de..d528806 100755
--- a/thirdparty/package-hive.sh
+++ b/thirdparty/package-hive.sh
@@ -37,13 +37,14 @@ ARTIFACT=apache-hive-$VERSION-bin
 wget https://archive.apache.org/dist/hive/hive-$VERSION/$ARTIFACT.tar.gz
 tar xf $ARTIFACT.tar.gz
 
-# Note: as of Hive 2.3.1, the druid-common jar contains the log4j configuration
-# used for the HMS, so it can't be stripped.
-for PROJECT in accumulo aether curator druid-handler hbase icu4j jackson jetty jsp maven
parquet zookeeper; do
+for PROJECT in accumulo aether avatica calcite curator druid groovy hbase icu4j jetty jsp
maven parquet zookeeper; do
   rm $ARTIFACT/lib/*$PROJECT*.jar
 done
 
-rm -rf $ARTIFACT/jdbc
 rm -rf $ARTIFACT/hcatalog
+rm -rf $ARTIFACT/jdbc
+rm -rf $ARTIFACT/lib/php
+rm -rf $ARTIFACT/lib/python
+rm -rf $ARTIFACT/lib/py
 
 tar czf $ARTIFACT-stripped.tar.gz $ARTIFACT

http://git-wip-us.apache.org/repos/asf/kudu/blob/9e506fca/thirdparty/vars.sh
----------------------------------------------------------------------
diff --git a/thirdparty/vars.sh b/thirdparty/vars.sh
index e5995f6..ab92c71 100644
--- a/thirdparty/vars.sh
+++ b/thirdparty/vars.sh
@@ -216,7 +216,7 @@ BISON_SOURCE=$TP_SOURCE_DIR/$BISON_NAME
 # below is the current head of branch-2.
 # Note: The Hive release binary tarball is stripped of unnecessary jars before
 # being uploaded. See thirdparty/package-hive.sh for details.
-HIVE_VERSION=fc4fe31a8f17aae8a25ae8b074ab67aa71e4f3cf
+HIVE_VERSION=6189dbdea543939e977f97170f9a37389f46eb29
 HIVE_NAME=apache-hive-$HIVE_VERSION-bin
 HIVE_SOURCE=$TP_SOURCE_DIR/$HIVE_NAME
 


Mime
View raw message