drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bridget Bevens (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (DRILL-5380) Document the usage of drill's parquet "date auto correction" flag
Date Fri, 24 Mar 2017 18:01:41 GMT

    [ https://issues.apache.org/jira/browse/DRILL-5380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15940832#comment-15940832

Bridget Bevens commented on DRILL-5380:

Please see http://drill.apache.org/docs/parquet-format/#date-value-auto-correction 
and let me know if any changes or additional documentation is required.


> Document the usage of drill's parquet "date auto correction" flag
> -----------------------------------------------------------------
>                 Key: DRILL-5380
>                 URL: https://issues.apache.org/jira/browse/DRILL-5380
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Documentation, Storage - Parquet
>            Reporter: Rahul Challapalli
>            Assignee: Bridget Bevens
> Drill used a wrong format for storing dates in parquet  before 1.8.0 release and as a
result it had compatibility issues with other parquet reader/writer tools. DRILL-4203 fixes
that issue by providing an auto-correction capability in drill's parquet reader. However if
someone really intends to use dates, which drill thinks are wrong, then we can use the approach
to disable auto-correction by drill
> {code}
> select l_shipdate from table(cp.`tpch/lineitem.parquet` (type => 'parquet', autoCorrectCorruptDates
=> false));
> {code}
> This needs to be documented

This message was sent by Atlassian JIRA

View raw message