avro-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "David McIntosh (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (AVRO-1332) Improve C# DatumReader performance
Date Mon, 09 Sep 2013 05:09:56 GMT

     [ https://issues.apache.org/jira/browse/AVRO-1332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

David McIntosh updated AVRO-1332:

    Affects Version/s:     (was: 1.7.4)
         Hadoop Flags:   (was: Incompatible change)
> Improve C# DatumReader performance
> ----------------------------------
>                 Key: AVRO-1332
>                 URL: https://issues.apache.org/jira/browse/AVRO-1332
>             Project: Avro
>          Issue Type: Improvement
>          Components: csharp
>    Affects Versions: 1.7.5
>            Reporter: David McIntosh
>            Priority: Minor
>              Labels: performance
>         Attachments: AVRO-1332.patch
> The current implementations of the C# datum readers perform resolution of the reader
and writer schema on every call to Read. In my tests this was causing it to perform poorly
when reading a large number of records (slower than parsing the same data from delimited text
files). It would be more efficient if the reader only needed to resolve the schemas once.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message