hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Clay McDonald <stuart.mcdon...@bateswhite.com>
Subject JOIN QUERY ERROR: SemanticException Generate Map Join Task Error: Class cannot be created (missing no-arg constructor)
Date Wed, 18 Jun 2014 15:41:53 GMT
I'm trying to run the following hive join query and get the following error. Any suggestions?

hive> select count(B.id) AS CNT FROM hdr_combined AS B JOIN upc_table AS C ON B.id = C.id;


com.esotericsoftware.kryo.KryoException: Class cannot be created (missing no-arg  constructor):
org.apache.hadoop.hive.serde2.objectinspector.primitive.WritableHiveVarcharObjectInspector
Serialization trace:objectInspector (org.apache.hadoop.hive.ql.exec.ColumnInfo)signature (org.apache.hadoop.hive.ql.exec.RowSchema)rowSchema
(org.apache.hadoop.hive.ql.exec.ReduceSinkOperator)
childOperators (org.apache.hadoop.hive.ql.exec.TableScanOperator)aliasToWork (org.apache.hadoop.hive.ql.plan.MapWork)mapWork
(org.apache.hadoop.hive.ql.plan.MapredWork)
        at com.esotericsoftware.kryo.Kryo.newInstantiator(Kryo.java:1097)
        at com.esotericsoftware.kryo.Kryo.newInstance(Kryo.java:1109)
        at com.esotericsoftware.kryo.serializers.FieldSerializer.create(FieldSerializer.java:526)
        at com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:502)
        at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:694)
        at com.esotericsoftware.kryo.serializers.ObjectField.read(ObjectField.java:106)
        at com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:507)
        at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:776)
        at com.esotericsoftware.kryo.serializers.CollectionSerializer.read(CollectionSerializer.java:112)
        at com.esotericsoftware.kryo.serializers.CollectionSerializer.read(CollectionSerializer.java:18)
        at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:694)
        at com.esotericsoftware.kryo.serializers.ObjectField.read(ObjectField.java:106)
        at com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:507)
        at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:694)
        at com.esotericsoftware.kryo.serializers.ObjectField.read(ObjectField.java:106)
        at com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:507)
        at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:776)
        at com.esotericsoftware.kryo.serializers.CollectionSerializer.read(CollectionSerializer.java:112)
        at com.esotericsoftware.kryo.serializers.CollectionSerializer.read(CollectionSerializer.java:18)
        at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:694)
        at com.esotericsoftware.kryo.serializers.ObjectField.read(ObjectField.java:106)
        at com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:507)
        at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:776)
        at com.esotericsoftware.kryo.serializers.MapSerializer.read(MapSerializer.java:139)
        at com.esotericsoftware.kryo.serializers.MapSerializer.read(MapSerializer.java:17)
        at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:694)
        at com.esotericsoftware.kryo.serializers.ObjectField.read(ObjectField.java:106)
        at com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:507)
        at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:694)
        at com.esotericsoftware.kryo.serializers.ObjectField.read(ObjectField.java:106)
        at com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:507)
        at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:672)
        at org.apache.hadoop.hive.ql.exec.Utilities.deserializeObjectByKryo(Utilities.java:810)
        at org.apache.hadoop.hive.ql.exec.Utilities.deserializePlan(Utilities.java:718)
        at org.apache.hadoop.hive.ql.exec.Utilities.clonePlan(Utilities.java:748)
        at org.apache.hadoop.hive.ql.optimizer.physical.CommonJoinTaskDispatcher.processCurrentTask(CommonJoinTaskDispatcher.java:503)
        at org.apache.hadoop.hive.ql.optimizer.physical.AbstractJoinTaskDispatcher.dispatch(AbstractJoinTaskDispatcher.java:182)
        at org.apache.hadoop.hive.ql.lib.TaskGraphWalker.dispatch(TaskGraphWalker.java:111)
        at org.apache.hadoop.hive.ql.lib.TaskGraphWalker.walk(TaskGraphWalker.java:194)
        at org.apache.hadoop.hive.ql.lib.TaskGraphWalker.startWalking(TaskGraphWalker.java:139)
        at org.apache.hadoop.hive.ql.optimizer.physical.CommonJoinResolver.resolve(CommonJoinResolver.java:79)
        at org.apache.hadoop.hive.ql.optimizer.physical.PhysicalOptimizer.optimize(PhysicalOptimizer.java:90)
        at org.apache.hadoop.hive.ql.parse.MapReduceCompiler.compile(MapReduceCompiler.java:300)
        at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:8410)
        at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:284)
        at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:441)
        at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:342)
        at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1000)
        at org.apache.hadoop.hive.ql.Driver.run(Driver.java:911)
        at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:259)
        at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:216)
        at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:413)
        at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:781)
        at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:675)
        at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:614)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl. java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
FAILED: SemanticException Generate Map Join Task Error: Class cannot be created (missing no-arg
constructor): org.apache.hadoop.hive.serde2.objectinspector.primitive.WritableHiveVarcharObjectInspector
Serialization trace:
objectInspector (org.apache.hadoop.hive.ql.exec.ColumnInfo)
signature (org.apache.hadoop.hive.ql.exec.RowSchema)
rowSchema (org.apache.hadoop.hive.ql.exec.ReduceSinkOperator)
childOperators (org.apache.hadoop.hive.ql.exec.TableScanOperator)
aliasToWork (org.apache.hadoop.hive.ql.plan.MapWork)
mapWork (org.apache.hadoop.hive.ql.plan.MapredWork)

Thanks, Clay

 

Mime
View raw message