avro-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ben Walsh <ben.wa...@byhiras.com>
Subject RE: Python avro performance
Date Wed, 14 Jan 2015 15:55:54 GMT
​
We have a Python C module which calls Avro's C implementation.

It can be about 70 times faster at reading than the standard Python implementation.

https://github.com/Byhiras/pyavroc

Currently it requires Avro-C to be built with some patches (available at https://github.com/Byhiras/avro).​
Some of these (eg. AVRO-1528 and AVRO-1572) are already in JIRA. I will try to get the rest
attached to JIRA so they can be added to the upstream code.

Cheers

Ben


From: Doug Cutting <cutting@apache.org>
Sent: 10 January 2015 00:01
To: user@avro.apache.org
Subject: Re: Python avro performance
    
On Fri, Jan 9, 2015 at 6:05 AM, Bruce Mitchener
<bruce.mitchener@gmail.com> wrote:
> Has anyone profiled the Python code or otherwise looked at the performance?

Not that I've heard of.  Optimizing Avro Python would be a great project.

Doug

    
Mime
View raw message