flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Till Rohrmann (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FLINK-944) Serialization problem of CollectionInputFormat
Date Tue, 17 Jun 2014 13:06:02 GMT
Till Rohrmann created FLINK-944:

             Summary: Serialization problem of CollectionInputFormat
                 Key: FLINK-944
                 URL: https://issues.apache.org/jira/browse/FLINK-944
             Project: Flink
          Issue Type: Bug
            Reporter: Till Rohrmann
            Assignee: Till Rohrmann

The CollectionInputFormat uses only the standard serialization means provided by the JVM.
Thus data types which are serializable with a TypeSerializer but does not implement the Serializable
interface cannot be used with a CollectionDataSource. Even worse, if one uses an aggregation
type such as a tuple, only the top level object will be checked for serializability. Consequently,
it will crash at runtime.

It would be more user friendly to not enforce that a used data type has to implement the Serializable
interface. Instead we should use the generated TypeSerializer to do the serialization. That
way, we are more flexible.

This message was sent by Atlassian JIRA

View raw message