impala-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alex Behm (Code Review)" <>
Subject [Impala-ASF-CR] IMPALA-2716: Hive/Impala incompatibility for timestamp data in Parquet
Date Tue, 11 Apr 2017 22:00:02 GMT
Alex Behm has posted comments on this change.

Change subject: IMPALA-2716: Hive/Impala incompatibility for timestamp data in Parquet

Patch Set 6:


I'm pretty happy with this change.

I think we should consider adding additional test cases for interesting boundary conditions,
e.g., when there is ambiguity in the tz -> UTC conversion, but not in this patch.
File fe/src/main/java/org/apache/impala/analysis/

Line 113:           "Invalid time zone in the the '%s' table property: %s",
double 'the'
File fe/src/test/java/org/apache/impala/analysis/

Line 665:     // Attempt to set '' table property. Positive case.
Let's move all the CREATE/ALTER tests into a separate TestParquetMrInt96WriteZone()

To me that org seems more natural.

Line 1882:         "\"/test-warehouse/alltypesagg_hive_13_1_parquet/" +
easier to read single quotes

Line 1904:         "\"/test-warehouse/alltypesagg_hive_13_1_parquet/" +
easier to read single quotes
File tests/custom_cluster/

Line 27:   '''Hive writes timestamps in Parquet files by first converting values from local
Thank you! This comment is very informative and well written.

Line 105:     parquet_fn = get_fs_path(
What does "fn" stand for? I'm thinking "file name", but this is not just a file name.

Line 123:           i ON = AND =  -- serves as a unique key
easier to read with the alias 'i' next to the table

Line 125:           (h.timestamp_col IS NULL AND i.timestamp_col IS NOT NULL)
simplify the first two conditions with:

h.timestamp_col IS NULL != i.timestamp_col IS NULL

please apply the same changes to queries in:
File tests/query_test/

Line 78:   def test_garbage_parquet_mr_write_zone(self, vector, unique_database):

Line 118:       # '' table property to tz_name triggers  a 'UTC'
extra space after "triggers"

To view, visit
To unsubscribe, visit

Gerrit-MessageType: comment
Gerrit-Change-Id: I3f24525ef45a2814f476bdee76655b30081079d6
Gerrit-PatchSet: 6
Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-Owner: Attila Jeges <>
Gerrit-Reviewer: Alex Behm <>
Gerrit-Reviewer: Attila Jeges <>
Gerrit-Reviewer: Michael Ho
Gerrit-Reviewer: Taras Bobrovytsky <>
Gerrit-Reviewer: Zoltan Ivanfi <>
Gerrit-HasComments: Yes

View raw message