Troubleshooting Hive Upgrade Issues

This section describes how to troubleshoot inconsistencies in an underlying database after creating tables with the datanucleus.schema.autoCreateAll property.

Prerequisites

The datanucleus.schema.autoCreateAll property creates tables gradually. After creating tables using this property, if you upgrade to Hive 2.3 using schematool, the schematool command will not be able to verify all the necessary tables because all the necessary tables were not created by the datanucleus.schema.autoCreateAll property.

Procedure

  1. Determine the version from which you are upgrading.
  2. Start MySQL: 
    mysql -u <user> -p <password>
  3. Run the following commands in your MySQL command line.
    • Upgrade from Hive 1.2
    • Upgrade from Hive 1.0
    • Upgrade from Hive 0.13
    USE metastore; 
SOURCE /opt/mapr/hive/hive-2.1/scripts/metastore/upgrade/mysql/hive-schema
        -1.2.0.mysql.sql;
SOURCE /opt/mapr/hive/hive-2.1/scripts/metastore/upgrade/mysql/hive-txn-schema
        -0.13.0.mysql.sql;                     
    USE metastore; 
SOURCE /opt/mapr/hive/hive-2.1/scripts/metastore/upgrade/mysql/hive-schema-0.14.0.
mysql.sql;                     
    USE metastore;
SOURCE /opt/mapr/hive/hive-2.1/scripts/metastore/upgrade/mysql/
hive-schema-0.13.0.mysql.sql;

Results

Running SOURCE for the version before the upgrade makes the underlying database consistent for running the schematool command with the -upgradeSchema option.