avro-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Joe Crobak <joec...@gmail.com>
Subject Re: mapred: avro data file input to text-based csv output
Date Tue, 28 Jun 2011 12:46:28 GMT
We use Pig and AvroStorage [1] to do this.  It's a very small pig script,
something like:

register piggybank.jar
define AvroStorage o.a.p.pb.AvroStorage()
data = LOAD '$INFILE' using AvroStorage;
store data into '$OUTPUT' using PigStorage(',');

[1] https://issues.apache.org/jira/browse/PIG-1748

On Mon, Jun 27, 2011 at 11:43 PM, Bo Shi <bs1984@gmail.com> wrote:

> Hey all,
> I've seen an example of taking a plain text file as an input to an
> AvroJob (using AvroUtf8InputFormat) but I haven't found anything about
> taking an Avro data file as input and producing a text-based file
> (CSV, say).  Any hints here?
> Thanks,
> Bo

View raw message