Return-Path: Delivered-To: apmail-avro-dev-archive@www.apache.org Received: (qmail 82564 invoked from network); 23 Dec 2010 05:18:02 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 23 Dec 2010 05:18:02 -0000 Received: (qmail 42472 invoked by uid 500); 23 Dec 2010 05:18:02 -0000 Delivered-To: apmail-avro-dev-archive@avro.apache.org Received: (qmail 42357 invoked by uid 500); 23 Dec 2010 05:18:01 -0000 Mailing-List: contact dev-help@avro.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@avro.apache.org Delivered-To: mailing list dev@avro.apache.org Received: (qmail 42349 invoked by uid 500); 23 Dec 2010 05:18:01 -0000 Delivered-To: apmail-hadoop-avro-dev@hadoop.apache.org Received: (qmail 42344 invoked by uid 99); 23 Dec 2010 05:18:00 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 23 Dec 2010 05:18:00 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=10.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: local policy) Received: from [205.234.18.191] (HELO zimbra.prxy.net) (205.234.18.191) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 23 Dec 2010 05:17:54 +0000 Received: from localhost (localhost.localdomain [127.0.0.1]) by zimbra.prxy.net (Postfix) with ESMTP id DEA128ED8AA9 for ; Wed, 22 Dec 2010 21:17:33 -0800 (PST) X-Virus-Scanned: amavisd-new at zimbra.prxy.net Received: from zimbra.prxy.net ([127.0.0.1]) by localhost (zimbra.prxy.net [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id IerjMo04pdXp for ; Wed, 22 Dec 2010 21:17:33 -0800 (PST) Received: from [192.168.1.104] (unknown [75.26.164.115]) by zimbra.prxy.net (Postfix) with ESMTPSA id 96F518ED8AA8 for ; Wed, 22 Dec 2010 21:17:33 -0800 (PST) Message-Id: From: Ken Krugler To: avro-dev@hadoop.apache.org Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v936) Subject: Extending Avro schema compilation Date: Wed, 22 Dec 2010 21:17:32 -0800 X-Mailer: Apple Mail (2.936) Hi all, I've started looking into leveraging the Avro schema definition support for Cascading workflows. Currently I manually generate a wrapper class (what we call a "Datum") for a Cascading Tuple, that gives me stronger typing and support for array/map types, which aren't natively supported by Cascading. But when a Tuple (a record) has many fields, generating this wrapper class becomes painful and error-prone. So I wanted to extend the SpecificCompiler class in Avro, but alter what it emits to be my target Java source for Datums. However the SpecificCompiler class isn't set up to be extended (private fields/methods), so I'm wondering if there's a better approach that I'm missing. Thanks, -- Ken -------------------------- Ken Krugler +1 530-210-6378 http://bixolabs.com e l a s t i c w e b m i n i n g