crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gabriel Reid (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (CRUNCH-289) Can't materialize PCollection of Avro SpecificRecords
Date Wed, 30 Oct 2013 20:47:28 GMT

     [ https://issues.apache.org/jira/browse/CRUNCH-289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Gabriel Reid updated CRUNCH-289:
--------------------------------

    Attachment: CRUNCH-289.patch

Patch to resolve the issue -- passes all integration tests, and I've tested it on a real cluster
to successfully materialize SpecificRecords. Unfortunately it's not possible to add tests
that check the underlying issue, as it can only be reproduced on a real cluster with a tool
that is started up with "hadoop jar".

> Can't materialize PCollection of Avro SpecificRecords
> -----------------------------------------------------
>
>                 Key: CRUNCH-289
>                 URL: https://issues.apache.org/jira/browse/CRUNCH-289
>             Project: Crunch
>          Issue Type: Bug
>            Reporter: Gabriel Reid
>         Attachments: CRUNCH-289.patch
>
>
> Due to the issue outlined in AVRO-1240, it's not possible (at least in some cases) to
locally materialize a PCollection of SpecificData Avro records -- attempting to do so results
in a confusing ClassCastException.



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message