avro-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Marcio Silva (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AVRO-1204) Schema.createUnion can produce schemas that aren't parseable due to redefinition of types
Date Sat, 17 Nov 2012 01:09:11 GMT

    [ https://issues.apache.org/jira/browse/AVRO-1204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13499294#comment-13499294
] 

Marcio Silva commented on AVRO-1204:
------------------------------------

Sorry, I should've been more thorough in testing the unit test (I stopped when I saw my same
error, should've looked at the stack trace) We were seeing this bug with some of our internal
schemas.  I'll try to see if I can create a better test to reproduce the error we were seeing.
                
> Schema.createUnion can produce schemas that aren't parseable due to redefinition of types
> -----------------------------------------------------------------------------------------
>
>                 Key: AVRO-1204
>                 URL: https://issues.apache.org/jira/browse/AVRO-1204
>             Project: Avro
>          Issue Type: Bug
>          Components: java
>    Affects Versions: 1.7.2, 1.7.3
>            Reporter: Marcio Silva
>         Attachments: 0001-Creating-test-case-to-illustrate-Union-schema-proble.patch,
AVRO-1204.patch
>
>
> Schemas returned from {{Schema.createUnion}} aren't always re-parsable (after calling
Schema.toString()).
> If you create a union of types that contain multiple references to the same type, the
resulting {{Schema}} instance returned can't be written to JSON and then re-parsed due to
a SchemaParseException on type redefinition.
> The fix probably involves changes to {{UnionSchema.toJson}} to ensure that any repeated
type definitions are replaced by a named reference.
> For a concrete example, the union of the following two schemas is problematic:
> {code:javascript|title=child-schema.avsc}
> {"type":"record",
>  "name":"UnionTestChild",
>  "namespace":"org.apache.avro",
>  "fields":[
>                { "name":"intField","type":"int"},
>                { "name":"stringField", "type":"string"}
>            ]
> }
> {code}
> {code:javascript|title=parent-schema.avsc}
> {
>    "type":"record",
>    "name":"UnionTestParent",
>    "namespace":"org.apache.avro",
>    "fields":[
>       {
>          "name":"child",
>          "type":{
>             "type":"record",
>             "name":"UnionTestChild",
>             "namespace":"org.apache.avro",
>             "fields":[
>                { "name":"intField","type":"int"},
>                { "name":"stringField", "type":"string"}
>             ]
>          }
>       }
>    ]
> }
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message