avro-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hong, Shunhui Welly" <Shunhui.Welly.H...@jpmorgan.com>
Subject Avro decode very slow in Python
Date Thu, 24 Mar 2016 21:03:14 GMT
Hi guys,

I am trying to decode avro binary data (55M took 5 mins) in Python. It seems 10+ times slower
than in Java. Any suggestions?

bytes_reader = io.BytesIO(raw_bytes)
decoder = avro.io.BinaryDecoder(bytes_reader)
reader = avro.io.DatumReader(schema)
decoded_data = reader.read(decoder)

Thank you,


This email is confidential and subject to important disclaimers and conditions including on
offers for the purchase or sale of securities, accuracy and completeness of information, 
viruses, confidentiality, legal privilege, and legal entity disclaimers, available at http://www.jpmorgan.com/pages/disclosures/email

View raw message