avro-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From snikhil0 <snik...@telenav.com>
Subject Avro and Hive contd
Date Fri, 24 Feb 2012 19:20:17 GMT
Has some one successfully used the SerDe for Avro provided by Jakob
(https://github.com/jghoman/haivvreo)?

I am using the exact versions of avro and hive recommended by the authors
but running into all kinds of problems just in running their examples...

Can someone please help me out?

create table test row format serde 'com.linkedin.haivvreo.AvroSerDe' with
serdeproperties ('schema.literal'='{"namespace": "com.linkedin.haivvreo",
"name": "test_schema", "type":"record", "fields":[{"name":"string1",
"type":"string"} ] }') stored as inputformat
'com.linkedin.haivvreo.AvroContainerInputFormat' outputformat
'com.linkedin.haivvreo.AvroContainerOutputFormat';
java.lang.NoClassDefFoundError: Could not initialize class
org.apache.avro.Schema
	at
com.linkedin.haivvreo.HaivvreoUtils.determineSchemaOrThrowException(HaivvreoUtils.java:50)
	at
com.linkedin.haivvreo.HaivvreoUtils.determineSchemaOrReturnErrorSchema(HaivvreoUtils.java:76)
	at com.linkedin.haivvreo.AvroSerDe.initialize(AvroSerDe.java:51)
	at
org.apache.hadoop.hive.metastore.MetaStoreUtils.getDeserializer(MetaStoreUtils.java:199)
	at org.apache.hadoop.hive.ql.metadata.Table.getDeserializer(Table.java:253)
	at org.apache.hadoop.hive.ql.metadata.Table.getCols(Table.java:484)
	at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:450)
	at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:3146)
	at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:213)
	at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:130)
	at
org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57)
	at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1063)
	at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:900)
	at org.apache.hadoop.hive.ql.Driver.run(Driver.java:748)
	at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:164)
	at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:241)
	at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:456)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
FAILED: Execution Error, return code -101 from
org.apache.hadoop.hive.ql.exec.DDLTask

My setup:
hive: 0.7.1
avro: 1.4.1
hadoop: 1.0.0
added the jackson jars as recommended using add jar on hive cli.

Thanks,
 

--
View this message in context: http://apache-avro.679487.n3.nabble.com/Avro-and-Hive-contd-tp3773468p3773468.html
Sent from the Avro - Users mailing list archive at Nabble.com.

Mime
View raw message