flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stephan Ewen <se...@apache.org>
Subject Re: Stringable Hashmap keys on POJOs
Date Fri, 05 Dec 2014 09:22:57 GMT
We are in the midst of replacing Avro in the serialization, so this should
spoon be fixed properly.

Until then, you could try to re-package the collection. Something like an
array of map entries, or so. Would that feasible?

Stephan
Am 04.12.2014 21:42 schrieb "Aljoscha Krettek" <aljoscha@apache.org>:

> I don't know any workaround. But maybe Avro should be avoided
> altogether for your requirements.
>
> What is the data that you want to move between operations?
>
> On Thu, Dec 4, 2014 at 7:13 PM, Paris Carbone <parisc@kth.se> wrote:
> > Hello,
> >
> > It seems that Avro fails to serialise POJOs that contain non-String or
> stringable keys<
> https://apache.googlesource.com/avro/+/40650540dcb8ca8a6b6235de5cdd36c0f6e2eb31/lang/java/avro/src/main/java/org/apache/avro/reflect/ReflectData.java#361
> >.
> > eg. in the example here<
> https://github.com/senorcarbone/incubator-flink/blob/72b6798b50396c962fc6cea20a2bcdd51eec06f4/flink-examples/flink-java-examples/src/main/java/org/apache/flink/examples/java/testing/LongMapKeyIssueExample.java>
> I get a compiler exception caused by:
> >
> > org.apache.avro.AvroTypeException: Map key class not String: class
> java.lang.Long
> >
> > Is there any known workaround/recommendation for this except for using
> String keys?
> > I need this for a use case of low latency data-intensive streaming so
> String conversions should be avoided.
> >
> > Paris
> >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message