flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Michele Bertoni <michele1.bert...@mail.polimi.it>
Subject problem with union
Date Tue, 14 Jul 2015 15:35:30 GMT
Hi everybody, this discussion started in an other thread about a problem in union, but you
said it was a different error then i am opening a new topic

I am doing the union of two dataset and I am getting this error




Exception in thread "main" org.apache.flink.api.common.InvalidProgramException: Cannot union
inputs of different types. Input1=scala.Tuple6(_1: Long, _2: String, _3: Long, _4: Long, _5:
Character, _6: ObjectArrayTypeInfo<GenericType<it.polimi.genomics.core.DataTypes.GValue>>),
input2=scala.Tuple6(_1: Long, _2: String, _3: Long, _4: Long, _5: Character, _6: ObjectArrayTypeInfo<GenericType<it.polimi.genomics.core.DataTypes.GValue>>)
	at org.apache.flink.api.java.operators.UnionOperator.<init>(UnionOperator.java:46)
	at org.apache.flink.api.scala.DataSet.union(DataSet.scala:1101)
	at it.polimi.genomics.flink.FlinkImplementation.operator.region.GenometricCover2$.apply(GenometricCover2.scala:125)
	...




Input1=
scala.Tuple6(_1: Long, _2: String, _3: Long, _4: Long, _5: Character, _6: ObjectArrayTypeInfo<GenericType<it.polimi.genomics.core.DataTypes.GValue>>)
input2=
scala.Tuple6(_1: Long, _2: String, _3: Long, _4: Long, _5: Character, _6: ObjectArrayTypeInfo<GenericType<it.polimi.genomics.core.DataTypes.GValue>>)


as you can see the two datasets have the same type
this error only happens with a custom data type (e.g. i am using an array of GValue, an array
of Int or Double works)

in the last flink version it was working (milestone and snapshot) now in 0.9.0 it is not

what can it be?


thanks for help

cheers,
Michele
Mime
View raw message