avro-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lunagariya, Dhaval " <dhaval.lunagar...@citi.com>
Subject Exception : Not in union
Date Wed, 27 Jan 2016 14:23:01 GMT
Hey folks,

Getting below Exception. Seems problem with schema file. I am unable to figure out. Can anyone
help me.

org.apache.crunch.CrunchRuntimeException: org.apache.avro.file.DataFileWriter$AppendWriteException:
org.apache.avro.UnresolvedUnionException: Not in union ["null","string"]: 0
        at org.apache.crunch.impl.mr.emit.MultipleOutputEmitter.emit(MultipleOutputEmitter.java:45)
        at org.apache.crunch.MapFn.process(MapFn.java:34)
        at org.apache.crunch.impl.mr.run.RTNode.process(RTNode.java:98)
        at org.apache.crunch.impl.mr.emit.IntermediateEmitter.emit(IntermediateEmitter.java:56)
        at com.citi.risk.retail.etl.bigdata.function.GC20FeedEnrichmentFn.process(GC20FeedEnrichmentFn.java:71)
        at com.citi.risk.retail.etl.bigdata.function.GC20FeedEnrichmentFn.process(GC20FeedEnrichmentFn.java:28)
        at org.apache.crunch.impl.mr.run.RTNode.process(RTNode.java:98)
        at org.apache.crunch.impl.mr.emit.IntermediateEmitter.emit(IntermediateEmitter.java:56)
        at org.apache.crunch.MapFn.process(MapFn.java:34)
        at org.apache.crunch.impl.mr.run.RTNode.process(RTNode.java:98)
        at org.apache.crunch.impl.mr.run.RTNode.process(RTNode.java:109)
        at org.apache.crunch.impl.mr.run.CrunchMapper.map(CrunchMapper.java:60)
        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:784)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:415)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1642)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:163)
Caused by: org.apache.avro.file.DataFileWriter$AppendWriteException: org.apache.avro.UnresolvedUnionException:
Not in union ["null","string"]: 0
        at org.apache.avro.file.DataFileWriter.append(DataFileWriter.java:296)
        at org.apache.crunch.types.avro.AvroOutputFormat$1.write(AvroOutputFormat.java:86)
        at org.apache.crunch.types.avro.AvroOutputFormat$1.write(AvroOutputFormat.java:83)
        at org.apache.crunch.io.CrunchOutputs.write(CrunchOutputs.java:133)
        at org.apache.crunch.impl.mr.emit.MultipleOutputEmitter.emit(MultipleOutputEmitter.java:41)
        ... 19 more
Caused by: org.apache.avro.UnresolvedUnionException: Not in union ["null","string"]: 0
        at org.apache.avro.generic.GenericData.resolveUnion(GenericData.java:607)
        at org.apache.avro.generic.GenericDatumWriter.resolveUnion(GenericDatumWriter.java:151)
        at org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:71)
        at org.apache.avro.generic.GenericDatumWriter.writeField(GenericDatumWriter.java:114)
        at org.apache.avro.generic.GenericDatumWriter.writeRecord(GenericDatumWriter.java:104)
        at org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:66)
        at org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:58)
        at org.apache.avro.file.DataFileWriter.append(DataFileWriter.java:290)
        ... 23 more




Regards,
Dhaval


Mime
View raw message