hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mark Grover <>
Subject Re: Migrating to hive 8.1 on EMR
Date Tue, 19 Jun 2012 19:22:36 GMT
Sorry, missed the link:

----- Original Message -----
From: "Mark Grover" <>
Sent: Tuesday, June 19, 2012 1:31:25 PM
Subject: Re: Migrating to hive 8.1 on EMR

On a somewhat related note, I had issues when using Amazon's MySQL server (on the master node)
as metastore on a Hive 0.8.1 cluster.
Related thread:
----- Original Message -----
From: "Carl Steinbach" <>
Sent: Monday, June 18, 2012 5:07:12 PM
Subject: Re: Migrating to hive 8.1 on EMR

Hi Ranjan, 

Looks like the NPE is getting generated here: 

if (0 == getCols().size()) { 
throw new HiveException( 
"at least one column must be specified for the table"); 

Which would seem to indicate that the table record which was fetched doesn't have any columns.

Did you run the metastore upgrade scripts for 0.8.0 (located in metastore/scripts/upgrade)?
Hive 0.8.0 includes HIVE-2246 which changed the name and schema of the metastore table used
to store column information. 



On Mon, Jun 18, 2012 at 12:56 PM, Ranjan Bagchi < > wrote: 


I've built a datastore using Hive 7.1 backed by S3 using persistent metadata. Now that hive
8.1 is available, I'd like to migrate to the new version. 

However, I'm having trouble reading tables with the persistent schema. Looking in the logs,
I'm getting stack traces like the following: 
2012-06-18 19:51:23,176 ERROR org.apache.hadoop.hive.ql.exec.Task (SessionState. 
java:printError(380)) - Failed with exception null 
at org.apache.hadoop.hive.ql.metadata.Table.checkValidity( 
at org.apache.hadoop.hive.ql.metadata.Hive.getTable( 
at org.apache.hadoop.hive.ql.metadata.Hive.getTable( 
at org.apache.hadoop.hive.ql.exec.DDLTask.describeTable( 
at org.apache.hadoop.hive.ql.exec.DDLTask.execute( 
at org.apache.hadoop.hive.ql.exec.Task.executeTask( 
at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.ja 
at org.apache.hadoop.hive.ql.Driver.launchTask( 
at org.apache.hadoop.hive.ql.Driver.execute( 
at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd( 
at org.apache.hadoop.hive.cli.CliDriver.processCmd( 
at org.apache.hadoop.hive.cli.CliDriver.processLine( 
at org.apache.hadoop.hive.cli.CliDriver.main( 
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 
at sun.reflect.NativeMethodAccessorImpl.invoke( 
at sun.reflect.DelegatingMethodAccessorImpl.invoke( 
at java.lang.reflect.Method.invoke( 
at org.apache.hadoop.util.RunJar.main( 

2012-06-18 19:51:23,180 ERROR org.apache.hadoop.hive.ql.Driver (
- FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask 

Does anyone have experience with this? 



View raw message