crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tom White (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (CRUNCH-358) Invalid optional field declaration in person.avsc
Date Wed, 26 Feb 2014 18:18:19 GMT

     [ https://issues.apache.org/jira/browse/CRUNCH-358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Tom White updated CRUNCH-358:
-----------------------------

    Attachment: CRUNCH-358.patch

I discovered this problem when  trying a later build of Parquet that has https://github.com/Parquet/parquet-mr/pull/299
in it. The problem I was hitting was that since the first type in the union was declared as
an array of string the default value was being interpreted as an empty list, rather than null,
which caused testProjectionSpecific(org.apache.crunch.io.parquet.AvroParquetFileSourceTargetIT)
to fail.

I've attached a patch with a trivial fix. Crunch tests still pass with it, and testProjectionSpecific
does too when using the later build of Parquet.

> Invalid optional field declaration in person.avsc
> -------------------------------------------------
>
>                 Key: CRUNCH-358
>                 URL: https://issues.apache.org/jira/browse/CRUNCH-358
>             Project: Crunch
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 0.9.0
>            Reporter: Tom White
>            Assignee: Tom White
>         Attachments: CRUNCH-358.patch
>
>
> The siblingnames field in person.avsc has a default value of null, even though the first
branch of the union is an array of string (not null). This is not a valid Avro schema (see
AVRO-1449) and should be fixed by reversing the types in the union.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Mime
View raw message