avro-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Han, Xiaodan" <xiaodan....@baml.com>
Subject 1.7.6 Slow Deserialization
Date Wed, 11 Jun 2014 20:05:09 GMT
Hi,

We are in the process of upgrading to 1.7.6 from 1.7.3. But it seems 1.7.6 deserialization
is slower by about 10%-30%. We did profiling and found the bottleneck being JsonProperties.getJsonProp().
Please see the profiling result below 1.7.6 vs. 1.7.3. I did some research in the list and
didn't find anything similar. Any idea what could have caused this?

Thanks you!

Dan.

// 1.7.6
CPU SAMPLES BEGIN (total = 31964)
rank   self  accum   count trace method
   1 70.67% 70.67%   22589 300641 org.apache.avro.JsonProperties.getJsonProp
   2  8.22% 78.89%    2628 300645 org.apache.avro.JsonProperties.getJsonProp
   3  6.30% 85.20%    2015 300640 org.apache.avro.JsonProperties.getJsonProp
   4  4.10% 89.30%    1311 300572 org.apache.avro.Schema$FixedSchema.getFixedSize
   5  1.68% 90.98%     538 300648 org.apache.avro.JsonProperties.getJsonProp

TRACE 300641: (thread=200001)
        org.apache.avro.JsonProperties.getJsonProp(JsonProperties.java:54)
        org.apache.avro.JsonProperties.getProp(JsonProperties.java:45)
        org.apache.avro.specific.SpecificDatumReader.getPropAsClass(SpecificDatumReader.java:92)
        org.apache.avro.specific.SpecificDatumReader.findStringClass(SpecificDatumReader.java:80)
        org.apache.avro.generic.GenericDatumReader.getStringClass(GenericDatumReader.java:394)
        org.apache.avro.generic.GenericDatumReader.readString(GenericDatumReader.java:351)
        org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:157)

// 1.7.3
CPU SAMPLES BEGIN (total = 22383)
rank   self  accum   count trace method
   1  4.81%  4.81%    1077 300527 org.apache.avro.Schema$FixedSchema.getFixedSize
   2  3.09%  7.90%     691 300624 org.apache.avro.io.BinaryDecoder$InputStreamByteSource.tryReadRaw
   3  1.61%  9.51%     361 300850 org.apache.avro.generic.GenericDatumReader.readString
   4  1.52% 11.04%     341 300924 org.apache.avro.generic.GenericDatumReader.readString
   5  1.44% 12.47%     322 300795 org.apache.avro.generic.GenericDatumReader.readString

----------------------------------------------------------------------
This message, and any attachments, is for the intended recipient(s) only, may contain information
that is privileged, confidential and/or proprietary and subject to important terms and conditions
available at http://www.bankofamerica.com/emaildisclaimer.   If you are not the intended recipient,
please delete this message.

Mime
View raw message