drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rahul Challapalli (JIRA)" <j...@apache.org>
Subject [jira] [Created] (DRILL-5380) Document the usage of drill's parquet "date auto correction" flag
Date Fri, 24 Mar 2017 17:13:41 GMT
Rahul Challapalli created DRILL-5380:

             Summary: Document the usage of drill's parquet "date auto correction" flag
                 Key: DRILL-5380
                 URL: https://issues.apache.org/jira/browse/DRILL-5380
             Project: Apache Drill
          Issue Type: Bug
          Components: Documentation, Storage - Parquet
            Reporter: Rahul Challapalli
            Assignee: Bridget Bevens

Drill used a wrong format for storing dates in parquet  before 1.8.0 release and as a result
it had compatibility issues with other parquet reader/writer tools. DRILL-4203 fixes that
issue by providing an auto-correction capability in drill's parquet reader. However if someone
really intends to use dates, which drill thinks are wrong, then we can use the approach to
disable auto-correction by drill

select l_shipdate from table(cp.`tpch/lineitem.parquet` (type => 'parquet', autoCorrectCorruptDates
=> false));

This needs to be documented

This message was sent by Atlassian JIRA

View raw message