Mailing-List: contact dev-help@crunch.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@crunch.apache.org
Date: Fri, 22 Nov 2013 00:45:35 +0000 (UTC)
From: "Josh Wills (JIRA)" <jira@apache.org>
To: crunch-dev@incubator.apache.org
Message-ID: <JIRA.12680309.1384961313218.11799.1385081135954@arcas>
In-Reply-To: <JIRA.12680309.1384961313218@arcas>
References: <JIRA.12680309.1384961313218@arcas>
Subject: [jira] [Resolved] (CRUNCH-300) Support reflected Avro record
 writing from MemPipeline
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


     [ https://issues.apache.org/jira/browse/CRUNCH-300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Josh Wills resolved CRUNCH-300.
-------------------------------

       Resolution: Fixed
    Fix Version/s: 0.9.0

Pushed this one to master; will tackle CRUNCH-302 next.

> Support reflected Avro record writing from MemPipeline
> ------------------------------------------------------
>
>                 Key: CRUNCH-300
>                 URL: https://issues.apache.org/jira/browse/CRUNCH-300
>             Project: Crunch
>          Issue Type: Improvement
>          Components: Core
>            Reporter: David Whiting
>            Assignee: Gabriel Reid
>            Priority: Minor
>             Fix For: 0.9.0
>
>         Attachments: 0001-Allow-MemPipeline-to-write-Avro-files-by-reflection.patch, CRUNCH-300b.patch
>
>
> MemPipeline doesn't support writing Avro records via reflection. It seems that this was half implemented but never finished, but I needed it to create some test data to run through a cluster MapReduce test. The current implementation correctly reflects the schema, but then uses a GenericDatumWriter to try and write the record, causing a ClassCastException. The correct way would be to get a ReflectDatumWriter from the ReflectDataFactory.


--
This message was sent by Atlassian JIRA
(v6.1#6144)