incubator-crunch-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jonathan Natkins <na...@cloudera.com>
Subject Writing Avro data to files
Date Thu, 13 Dec 2012 18:35:43 GMT
Out of curiosity, is there a way to write output from a Crunch pipeline
into an Avro-format file? It seems that if you do the
collection.write(To.avroFile(path)), you end up just writing JSON. It can
certainly be read into an Avro object, but it seems like it would be more
efficient to write binary data to the file, so no parsing has to happen.

Have I missed an API, or is this a missing feature?

Thanks,
Natty

Mime
View raw message