crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gabriel Reid (JIRA)" <>
Subject [jira] [Updated] (CRUNCH-289) Can't materialize PCollection of Avro SpecificRecords
Date Wed, 30 Oct 2013 20:47:28 GMT


Gabriel Reid updated CRUNCH-289:

    Attachment: CRUNCH-289.patch

Patch to resolve the issue -- passes all integration tests, and I've tested it on a real cluster
to successfully materialize SpecificRecords. Unfortunately it's not possible to add tests
that check the underlying issue, as it can only be reproduced on a real cluster with a tool
that is started up with "hadoop jar".

> Can't materialize PCollection of Avro SpecificRecords
> -----------------------------------------------------
>                 Key: CRUNCH-289
>                 URL:
>             Project: Crunch
>          Issue Type: Bug
>            Reporter: Gabriel Reid
>         Attachments: CRUNCH-289.patch
> Due to the issue outlined in AVRO-1240, it's not possible (at least in some cases) to
locally materialize a PCollection of SpecificData Avro records -- attempting to do so results
in a confusing ClassCastException.

This message was sent by Atlassian JIRA

View raw message