hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Prasad Mujumdar" <>
Subject Review Request 14169: HIVE-3764: Support metastore version consistency check
Date Tue, 17 Sep 2013 06:13:18 GMT

This is an automatically generated e-mail. To reply, visit:

Review request for hive, Ashutosh Chauhan and Brock Noland.

Bugs: HIVE-3764

Repository: hive-git


This is a 0.12 specific patch. The trunk patch will include additional metastore scripts which
I will attach separately to the ticket.

- Added a new table in the metastore schema to store the Hive version in the metastore.
- Metastore handler compare the version stored in the schema with its own version. If there's
a mismatch, then it can either record the correct version or raise error. The behavior is
configurable via a new Hive config. This config when set, also restrict dataNucleus to auto
upgrade the schema.
- The new schema creation and upgrade scripts record the new version in the metastore version
- Added 0.12 upgrade scripts for all supported DBs to creates the new table version tables
in 0.12 metastore schema

The current patch has the verification turned off by default. I would prefer to keep it enabled,
though it require any add-hoc setup to explicitly disable it (or create the metastore schema
by running scripts). The default can be changed or left as is as per the consensus. 


  common/src/java/org/apache/hadoop/hive/conf/ 22149e4 
  conf/hive-default.xml.template 9a3fc1d 
  metastore/scripts/upgrade/derby/014-HIVE-3764.derby.sql PRE-CREATION 
  metastore/scripts/upgrade/derby/hive-schema-0.12.0.derby.sql cce544f 
  metastore/scripts/upgrade/derby/upgrade-0.10.0-to-0.11.0.derby.sql cae7936 
  metastore/scripts/upgrade/derby/upgrade-0.11.0-to-0.12.0.derby.sql 492cc93 
  metastore/scripts/upgrade/derby/upgrade.order.derby PRE-CREATION 
  metastore/scripts/upgrade/mysql/014-HIVE-3764.mysql.sql PRE-CREATION 
  metastore/scripts/upgrade/mysql/hive-schema-0.12.0.mysql.sql 22a77fe 
  metastore/scripts/upgrade/mysql/upgrade-0.11.0-to-0.12.0.mysql.sql 375a05f 
  metastore/scripts/upgrade/mysql/upgrade.order.mysql PRE-CREATION 
  metastore/scripts/upgrade/oracle/ PRE-CREATION 
  metastore/scripts/upgrade/oracle/ 85a0178 
  metastore/scripts/upgrade/oracle/upgrade-0.10.0-to-0.11.0.mysql.sql PRE-CREATION 
  metastore/scripts/upgrade/oracle/ a2d0901 
  metastore/scripts/upgrade/oracle/ PRE-CREATION 
  metastore/scripts/upgrade/postgres/014-HIVE-3764.postgres.sql PRE-CREATION 
  metastore/scripts/upgrade/postgres/hive-schema-0.12.0.postgres.sql 7b319ba 
  metastore/scripts/upgrade/postgres/upgrade-0.11.0-to-0.12.0.postgres.sql 9da0a1b 
  metastore/scripts/upgrade/postgres/upgrade.order.postgres PRE-CREATION 
  metastore/src/java/org/apache/hadoop/hive/metastore/ 39dda92 
  metastore/src/java/org/apache/hadoop/hive/metastore/ PRE-CREATION

  metastore/src/java/org/apache/hadoop/hive/metastore/ a27243d 
  metastore/src/java/org/apache/hadoop/hive/metastore/ e410c3a 
  metastore/src/model/org/apache/hadoop/hive/metastore/model/ PRE-CREATION

  metastore/src/model/package.jdo c42b5b0 
  metastore/src/test/org/apache/hadoop/hive/metastore/ 8066784

  metastore/src/test/org/apache/hadoop/hive/metastore/ 0f9b16c

  metastore/src/test/org/apache/hadoop/hive/metastore/ PRE-CREATION



Added new tests for schema verification. Manually tested the upgrades using derby and MySQL.


Prasad Mujumdar

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message