crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Josh Wills (JIRA)" <>
Subject [jira] [Commented] (CRUNCH-573) Avro union in cogroup doesn't check for nested unions
Date Fri, 16 Oct 2015 18:54:05 GMT


Josh Wills commented on CRUNCH-573:

I think that automatically "flattening" the union types inside of Avros.unionOf is the way
to go, i.e., a unionOf(union1, union2) -> union of the composite types inside of union1
and union2. I don't see an obvious issue with that off the top of my head; does anyone else?

> Avro union in cogroup doesn't check for nested unions
> -----------------------------------------------------
>                 Key: CRUNCH-573
>                 URL:
>             Project: Crunch
>          Issue Type: Bug
>    Affects Versions: 0.13.0
>            Reporter: Adric Eckstein
> If one of the Cogroup.cogroup() inputs PType is an avro union, the cogroup() method attempts
to construct a union of the input PTypes, which throws a Avro RuntimeException for a nested
union.  This is similar to CRUNCH-547.
> The bug could be fixed by either modifying the Avros.unionOf() method to check for union
input types, or by unnesting the types in cogroup() prior to constructing the avro union.

This message was sent by Atlassian JIRA

View raw message