avro-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Douglas Creager (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AVRO-396) Add DataFileReadTool equivalent to Avro C
Date Tue, 07 Jun 2011 17:14:59 GMT

    [ https://issues.apache.org/jira/browse/AVRO-396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13045545#comment-13045545

Douglas Creager commented on AVRO-396:

I have an implementation of two new command-line tools, avrocat and avropipe, available on
a github tracking branch:


The avrocat tool prints the contents of an Avro data file to stdout, one record per line,
using the JSON encoding.  I haven't used DataFileReadTool, but I'm guessing they're equivalent.
 (avrocat is definitely equivalent to the Python binding's "avro tool dump" command.)

The avropipe command prints out a slightly different format, where each scalar value appears
on a single line.  The values are prefixed with a "path" that indicates where the scalar is
in the arbitrarily deep input record format.  The output is equivalent to treating the data
file as an array of JSON values, and sending that array through the [jsonpipe|https://github.com/dvxhouse/jsonpipe]

The commands depend on the new value interface from AVRO-837, which I wasn't planning on back-porting
to the 1.5 library.  Once AVRO-837 has been tested and committed to SVN, I'll commit this
as well.

> Add DataFileReadTool equivalent to Avro C
> -----------------------------------------
>                 Key: AVRO-396
>                 URL: https://issues.apache.org/jira/browse/AVRO-396
>             Project: Avro
>          Issue Type: Improvement
>          Components: c
>            Reporter: Eli Collins
>            Priority: Minor

This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message