avro-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sandy Ryza (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AVRO-1476) Make position field of org.apache.avro.Schema not transient.
Date Fri, 16 May 2014 11:00:01 GMT

    [ https://issues.apache.org/jira/browse/AVRO-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13999249#comment-13999249
] 

Sandy Ryza commented on AVRO-1476:
----------------------------------

+1 to this as well.  Kryo serialization, the most common internal serialization framework
for Spark also ignores this field, making it impossible to pass GenericData.Records through
Spark stages.

> Make position field of org.apache.avro.Schema not transient.
> ------------------------------------------------------------
>
>                 Key: AVRO-1476
>                 URL: https://issues.apache.org/jira/browse/AVRO-1476
>             Project: Avro
>          Issue Type: Task
>          Components: java
>    Affects Versions: 1.7.7, 1.8.0
>            Reporter: Robert Chu
>            Priority: Minor
>             Fix For: 1.7.7
>
>         Attachments: AVRO-1476.patch
>
>
> Referring to: https://github.com/apache/avro/blob/trunk/lang/java/avro/src/main/java/org/apache/avro/Schema.java#L358
> [~kryzthov] did some research into possible causes/reasons for this field to be marked
as transient but was unable to find any reason. The org.apache.avro.Schema class is not marked
as serializable so this transient field serves no purpose. This transient field can cause
odd behaviors with external serialization frameworks (and the built-in java serialization
framework) when trying to serialize schemas.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message