hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Szehon Ho" <>
Subject Re: Review Request 22174: HIVE-6394 Implement Timestmap in ParquetSerde
Date Sat, 07 Jun 2014 00:06:09 GMT

This is an automatically generated e-mail. To reply, visit:

(Updated June 7, 2014, 12:06 a.m.)

Review request for hive, Brock Noland, justin coffey, and Xuefu Zhang.


One more change, adding the 'NanoTime' class in Hive, as it was an example class in parquet.

Let's go with using un-annotated INT96 for parquet, that's what other consuming applications
have been doing.  When the annotation does come, we'll move to that.

Bugs: HIVE-6394

Repository: hive-git


This uses the Jodd library to convert java.sql.Timestamp type used by Hive into the {julian-day:nanos}
format expected by parquet, and vice-versa.

Diffs (updated)

  data/files/parquet_types.txt 0be390b 
  pom.xml 4bb8880 
  ql/pom.xml 13c477a 
  ql/src/java/org/apache/hadoop/hive/ql/io/parquet/convert/ 4da0d30 
  ql/src/java/org/apache/hadoop/hive/ql/io/parquet/convert/ 29f7e11

  ql/src/java/org/apache/hadoop/hive/ql/io/parquet/serde/ fb2f5a8 
  ql/src/java/org/apache/hadoop/hive/ql/io/parquet/timestamp/ PRE-CREATION 
  ql/src/java/org/apache/hadoop/hive/ql/io/parquet/timestamp/ PRE-CREATION

  ql/src/java/org/apache/hadoop/hive/ql/io/parquet/write/ 3490061 
  ql/src/test/org/apache/hadoop/hive/ql/io/parquet/serde/ PRE-CREATION

  ql/src/test/queries/clientpositive/parquet_types.q 5d6333c 
  ql/src/test/results/clientpositive/parquet_types.q.out c23f7f1 



Unit tests the new libraries, and also added timestamp data in the "parquet_types" q-test.


Szehon Ho

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message