drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rahul Challapalli (JIRA)" <j...@apache.org>
Subject [jira] [Closed] (DRILL-5380) Document the usage of drill's parquet "date auto correction" flag
Date Mon, 27 Mar 2017 20:32:41 GMT

     [ https://issues.apache.org/jira/browse/DRILL-5380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Rahul Challapalli closed DRILL-5380.

> Document the usage of drill's parquet "date auto correction" flag
> -----------------------------------------------------------------
>                 Key: DRILL-5380
>                 URL: https://issues.apache.org/jira/browse/DRILL-5380
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Documentation, Storage - Parquet
>            Reporter: Rahul Challapalli
>            Assignee: Bridget Bevens
> Drill used a wrong format for storing dates in parquet  before 1.8.0 release and as a
result it had compatibility issues with other parquet reader/writer tools. DRILL-4203 fixes
that issue by providing an auto-correction capability in drill's parquet reader. However if
someone really intends to use dates, which drill thinks are wrong, then we can use the approach
to disable auto-correction by drill
> {code}
> select l_shipdate from table(cp.`tpch/lineitem.parquet` (type => 'parquet', autoCorrectCorruptDates
=> false));
> {code}
> This needs to be documented

This message was sent by Atlassian JIRA

View raw message