avro-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Russell Jurney (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (AVRO-1412) Python Avro library can't read Avros made with Pig builtin AvroStorage
Date Fri, 20 Dec 2013 04:40:10 GMT

     [ https://issues.apache.org/jira/browse/AVRO-1412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Russell Jurney resolved AVRO-1412.
----------------------------------

            Tags: pig
      Resolution: Fixed
    Release Note: Fixed in Pig 0.13/0.12.1 in PIG-3621

> Python Avro library can't read Avros made with Pig builtin AvroStorage
> ----------------------------------------------------------------------
>
>                 Key: AVRO-1412
>                 URL: https://issues.apache.org/jira/browse/AVRO-1412
>             Project: Avro
>          Issue Type: Bug
>          Components: python
>    Affects Versions: 1.7.4
>            Reporter: Russell Jurney
>              Labels: pig, pig_avro, python
>
> Using this script:
> from avro import schema, datafile, io
> import pprint
> import sys
> import json
> field_id = None
> Optional key to print
> if (len(sys.argv) > 2):
> field_id = sys.argv[2]
> Test reading avros
> rec_reader = io.DatumReader()
> Create a 'data file' (avro file) reader
> df_reader = datafile.DataFileReader(
> open(sys.argv[1]),
> rec_reader
> )
> the last line fails with:
> Traceback (most recent call last):
> File "/Users/rjurney/bin/cat_avro", line 22, in <module>
> rec_reader
> File "/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/avro/datafile.py",
line 247, in _init_
> self.datum_reader.writers_schema = schema.parse(self.get_meta(SCHEMA_KEY))
> File "/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/avro/schema.py",
line 784, in parse
> return make_avsc_object(json_data, names)
> File "/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/avro/schema.py",
line 740, in make_avsc_object
> return RecordSchema(name, namespace, fields, names, type, doc, other_props)
> File "/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/avro/schema.py",
line 653, in _init_
> other_props)
> File "/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/avro/schema.py",
line 294, in _init_
> new_name = names.add_name(name, namespace, self)
> File "/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/avro/schema.py",
line 268, in add_name
> raise SchemaParseException(fail_msg)
> avro.schema.SchemaParseException: record is a reserved type name.



--
This message was sent by Atlassian JIRA
(v6.1.4#6159)

Mime
View raw message