avro-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Doug Cutting (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AVRO-1332) Improve C# DatumReader performance
Date Thu, 12 Sep 2013 21:58:53 GMT

    [ https://issues.apache.org/jira/browse/AVRO-1332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13765941#comment-13765941

Doug Cutting commented on AVRO-1332:

You're right, I was using the -2 version of the patch.  Tests pass with the -3 version.
> Improve C# DatumReader performance
> ----------------------------------
>                 Key: AVRO-1332
>                 URL: https://issues.apache.org/jira/browse/AVRO-1332
>             Project: Avro
>          Issue Type: Improvement
>          Components: csharp
>    Affects Versions: 1.7.5
>            Reporter: David McIntosh
>            Priority: Minor
>              Labels: performance
>         Attachments: AVRO-1332-2.patch, AVRO-1332-3.patch, AVRO-1332.patch
> The current implementations of the C# datum readers perform resolution of the reader
and writer schema on every call to Read. In my tests this was causing it to perform poorly
when reading a large number of records (slower than parsing the same data from delimited text
files). It would be more efficient if the reader only needed to resolve the schemas once.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message