crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "David Whiting (JIRA)" <>
Subject [jira] [Created] (CRUNCH-300) Support reflected Avro record writing from MemPipeline
Date Wed, 20 Nov 2013 15:29:35 GMT
David Whiting created CRUNCH-300:

             Summary: Support reflected Avro record writing from MemPipeline
                 Key: CRUNCH-300
             Project: Crunch
          Issue Type: Improvement
            Reporter: David Whiting
            Priority: Minor
         Attachments: 0001-Allow-MemPipeline-to-write-Avro-files-by-reflection.patch

MemPipeline doesn't support writing Avro records via reflection. It seems that this was half
implemented but never finished, but I needed it to create some test data to run through a
cluster MapReduce test. The current implementation correctly reflects the schema, but then
uses a GenericDatumWriter to try and write the record, causing a ClassCastException. The correct
way would be to get a ReflectDatumWriter from the ReflectDataFactory.

This message was sent by Atlassian JIRA

View raw message