ambari-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dmitro Lisnichenko" <dlysniche...@hortonworks.com>
Subject Re: Review Request 36435: Rolling upgrade failed on Hive restart for Centos 7
Date Sun, 12 Jul 2015 19:46:49 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/36435/
-----------------------------------------------------------

(Updated July 12, 2015, 7:46 p.m.)


Review request for Ambari, Alejandro Fernandez, Jonathan Hurley, Mahadev Konar, and Nate Cole.


Changes
-------

----------------------------------------------------------------------
Ran 263 tests in 7.722s

OK
----------------------------------------------------------------------
Total run:803
Total errors:0
Total failures:0
OK


Bugs: AMBARI-12391
    https://issues.apache.org/jira/browse/AMBARI-12391


Repository: ambari


Description
-------

It's a Metastore restart failure
2015-07-09 18:10:15,641 - Executing Metastore Rolling Upgrade pre-restart
2015-07-09 18:10:15,643 - Upgrading Hive Metastore
2015-07-09 18:10:15,645 - Execute['('cp', '/usr/hdp/current/hive-metastore/lib/mysql-connector-java.jar',
u'/usr/hdp/2.3.0.0-2545/hive/lib')'] {'path': ['/bin', '/usr/bin/'], 'sudo': True}
2015-07-09 18:10:15,682 - Execute['/usr/hdp/2.3.0.0-2545/hive/bin/schematool -dbType mysql
-upgradeSchema'] {'logoutput': True, 'environment': {'HIVE_CONF_DIR': '/usr/hdp/current/hive-metastore/conf/conf.server'},
'tries': 1, 'user': 'hive'}
WARNING: Use "yarn jar" to launch YARN applications.
org.apache.hadoop.hive.metastore.HiveMetaException: Failed to load driver
*** schemaTool failed ***
When I tried a dryrun,
sudo -u hive /usr/hdp/2.3.0.0-2545/hive/bin/schematool -dryRun -dbType mysql -upgradeSchema
it doesn't seem to fail on the driver load issue, though it was failing on something else.
I am assuming this is related to us missing some libraries during rolling-upgrades.
But we need to find out what exactly it is that is missing. Is it mysql-connector-java.jar
? Does it need to be readable by hive user, given the ugpradeSchema command above is running
as hive?
# ls -l /usr/hdp/2.3.0.0-2545/hive/lib/mysql-connector-java.jar
-rw-r-----. 1 root root 959987 Jul  9 18:10 /usr/hdp/2.3.0.0-2545/hive/lib/mysql-connector-java.jar


Diffs (updated)
-----

  ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/hive_metastore.py
a17ea4f 
  ambari-server/src/test/python/stacks/2.1/HIVE/test_hive_metastore.py dc1933b 

Diff: https://reviews.apache.org/r/36435/diff/


Testing
-------

Could not test manually - yum refuses to install Centos 7 packages on my local VMs.
Issue should be common also for Centos 6 with non-defauld umask. But could not test under
Centos 6 as well, because of blocker attached to jira.
Going to invoke patch during next QE run to test.


-
-
-----------------------------------------------------------------------
Ran 263 tests in 7.760s

OK
----------------------------------------------------------------------
Total run:803
Total errors:0
Total failures:0
OK


Thanks,

Dmitro Lisnichenko


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message