Return-Path: X-Original-To: apmail-crunch-dev-archive@www.apache.org Delivered-To: apmail-crunch-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 922A110DE4 for ; Mon, 18 Nov 2013 02:37:21 +0000 (UTC) Received: (qmail 60332 invoked by uid 500); 18 Nov 2013 02:37:21 -0000 Delivered-To: apmail-crunch-dev-archive@crunch.apache.org Received: (qmail 60304 invoked by uid 500); 18 Nov 2013 02:37:21 -0000 Mailing-List: contact dev-help@crunch.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@crunch.apache.org Delivered-To: mailing list dev@crunch.apache.org Received: (qmail 60296 invoked by uid 500); 18 Nov 2013 02:37:21 -0000 Delivered-To: apmail-incubator-crunch-dev@incubator.apache.org Received: (qmail 60293 invoked by uid 99); 18 Nov 2013 02:37:21 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 18 Nov 2013 02:37:21 +0000 Date: Mon, 18 Nov 2013 02:37:21 +0000 (UTC) From: "Micah Whitacre (JIRA)" To: crunch-dev@incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (CRUNCH-293) Injection of reader into AvroRecordReader MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/CRUNCH-293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Micah Whitacre updated CRUNCH-293: ---------------------------------- Attachment: CRUNCH-293_v2.patch Here's a patch that combines the two factories. Altered the method names to differentiate the reflect and the specific. Still need a bit more verification from some consumers that this handles injection of the reader in all needed cases. > Injection of reader into AvroRecordReader > ----------------------------------------- > > Key: CRUNCH-293 > URL: https://issues.apache.org/jira/browse/CRUNCH-293 > Project: Crunch > Issue Type: Improvement > Components: Core > Affects Versions: 0.7.0, 0.8.0 > Reporter: Micah Whitacre > Assignee: Micah Whitacre > Attachments: CRUNCH-293.patch, CRUNCH-293_v2.patch > > > With CRUNCH-243, I wanted to support injecting custom readers to handle the cases like passivity between Avro Schema. The changes made however were not complete as we also need to be able to inject a reader into the AvroRecordReader which constructs its own SpecificDatumReader. > We could create a SpecificDataFactory which emulates the ReflectDataFactory. Or simplify to a single DataFactory which will create either Reflect/Specific/Generic. Thoughts? -- This message was sent by Atlassian JIRA (v6.1#6144)