hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Anthony Hsu via Review Board <>
Subject Review Request 62247: HIVE-17394: AvroSerde is regenerating TypeInfo objects for each nullable Avro field for every row
Date Tue, 12 Sep 2017 15:04:57 GMT

This is an automatically generated e-mail. To reply, visit:

Review request for hive, Carl Steinbach and Ratandeep Ratti.

Bugs: HIVE-17394

Repository: hive-git


Previously, when Avro found a nullable union in the reader schema, it would regenerate the
TypeInfo for the field for every record. This patch reuses the same TypeInfo that only needs
to be calculated once.

In our testing, we found this improved count() queries by 2x.


  serde/src/java/org/apache/hadoop/hive/serde2/avro/ ecfe15f59dac04bda3f8f1275babebf736608a6b



`mvn clean package -DskipTests -Dmaven.javadoc.skip=true` succeeded.


Anthony Hsu

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message