avro-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Scott Carey (JIRA)" <j...@apache.org>
Subject [jira] Created: (AVRO-753) Java: Improve BinaryEncoder Performance
Date Tue, 01 Feb 2011 09:07:28 GMT
Java:  Improve BinaryEncoder Performance

                 Key: AVRO-753
                 URL: https://issues.apache.org/jira/browse/AVRO-753
             Project: Avro
          Issue Type: Improvement
          Components: java
            Reporter: Scott Carey
            Assignee: Scott Carey
             Fix For: 1.5.0

BinaryEncoder has not had a performance improvement pass like BinaryDecoder did.  It still
mostly writes directly to the underlying OutputStream which is not optimal for performance.
 I like to use a rule that if you are writing to an OutputStream or reading from an InputStream
in chunks smaller than 128 bytes, you have a performance problem.

Measurements indicate that optimizing BinaryEncoder yields a 2.5x to 6x performance improvement.
 The process is significantly simpler than BinaryDecoder because 'pushing' is easier than
'pulling' -- and also because we do not need a 'direct' variant because BinaryEncoder already
buffers sometimes.

This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message