hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mark Wagner (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HIVE-16408) SchemaToTypeInfo in AvroSerde makes many calls to synchronized functions
Date Fri, 07 Apr 2017 19:29:41 GMT
Mark Wagner created HIVE-16408:
----------------------------------

             Summary: SchemaToTypeInfo in AvroSerde makes many calls to synchronized functions
                 Key: HIVE-16408
                 URL: https://issues.apache.org/jira/browse/HIVE-16408
             Project: Hive
          Issue Type: Bug
          Components: Serializers/Deserializers
            Reporter: Mark Wagner


The generateTypeInfo method uses schema.getProp and schema.getJsonProp to retrieve metadata
from the Avro schema. Both of those methods result in synchronization on the schema. generateTypeInfo
is being called for every nullable field in every record, which makes it a significant bottleneck
in multi-threaded use.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message