avro-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sam Groth <sgr...@yahoo-inc.com>
Subject Re: Avro sample/test files
Date Mon, 14 Dec 2015 03:18:37 GMT
You can create avro files using the avro-tools.jar. All you need to do is write a schema. How
to get the jar is documented here: http://avro.apache.org/docs/1.7.7/gettingstartedjava.html Then
run something like "java -jar avro-tools-1.7.7.jar random --schema-file [your schema file]
--count 10 data.avro" to generate data.
Another approach, if you want to customize the data., would be to use the Avro python APIs
which are really simple. See http://avro.apache.org/docs/1.7.7/gettingstartedpython.html

Hope this helps,Sam

    On Sunday, December 13, 2015 4:30 PM, John Lilley <john.lilley@redpoint.net> wrote:

 #yiv7703157095 #yiv7703157095 -- _filtered #yiv7703157095 {panose-1:2 4 5 3 5 4 6 3 2 4;}
_filtered #yiv7703157095 {font-family:Calibri;panose-1:2 15 5 2 2 2 4 3 2 4;} _filtered #yiv7703157095
{panose-1:2 11 5 2 2 2 2 2 2 4;}#yiv7703157095 #yiv7703157095 p.yiv7703157095MsoNormal, #yiv7703157095
li.yiv7703157095MsoNormal, #yiv7703157095 div.yiv7703157095MsoNormal {margin:0in;margin-bottom:.0001pt;font-size:12.0pt;}#yiv7703157095
a:link, #yiv7703157095 span.yiv7703157095MsoHyperlink {color:blue;text-decoration:underline;}#yiv7703157095
a:visited, #yiv7703157095 span.yiv7703157095MsoHyperlinkFollowed {color:purple;text-decoration:underline;}#yiv7703157095
span.yiv7703157095hoenzb {}#yiv7703157095 span.yiv7703157095EmailStyle18 {color:#1F497D;}#yiv7703157095
.yiv7703157095MsoChpDefault {} _filtered #yiv7703157095 {margin:1.0in 1.0in 1.0in 1.0in;}#yiv7703157095
div.yiv7703157095WordSection1 {}#yiv7703157095 Everything may be explained, which is of limited
help to me.  What I’m after is interop validation.  I need files that others have written
to ensure that our use of Avro is able to handle files written by other applications.  Does
anything like that exist for public consumption? Thanks, John Lilley    From: Chris Miller
Sent: Sunday, December 13, 2015 10:14 AM
To: user@avro.apache.org
Subject: Re: Avro sample/test files    It's really pretty simple. Everything is explained
here with examples: http://avro.apache.org/docs/1.7.7/spec.html. That's what I used to figure
out how to build my schema.    
 -- Chris Miller    On Mon, Dec 14, 2015 at 1:09 AM, John Lilley <john.lilley@redpoint.net>
Does anyone know of a website/repository for Avro sample or test files?  I’ve crawled around
the source folders and things seem to be fairly limited.  Perhaps I’m missing something
obvious and need to RTFM?   Mostly I am looking for practical examples with multiple records,
containing complex column types.   If you have any Avro files that you can share, please
do!   John Lilley   

View raw message