drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (DRILL-6016) Error reading INT96 created by Apache Spark
Date Wed, 14 Mar 2018 09:58:00 GMT

    [ https://issues.apache.org/jira/browse/DRILL-6016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16398344#comment-16398344

ASF GitHub Bot commented on DRILL-6016:

Github user parthchandra commented on the issue:

    @rajrahul, thanks for submitting the patch. It looks good. I guess we missed dictionary
encoded int96 timestamps (even though timestamps with nanosecond precision) are the one thing
that should never, ever, be dictionary encoded!
    Just to make sure, I tried the use the sample file in DRILL-6016, but I could not even
unzip it! Can you please check and see if the file is correct? WE can use that to create the
unit test as well.

> Error reading INT96 created by Apache Spark
> -------------------------------------------
>                 Key: DRILL-6016
>                 URL: https://issues.apache.org/jira/browse/DRILL-6016
>             Project: Apache Drill
>          Issue Type: Bug
>         Environment: Drill 1.11
>            Reporter: Rahul Raj
>            Priority: Major
>             Fix For: 1.14.0
> Hi,
> I am getting the error - SYSTEM ERROR : ClassCastException: org.apache.drill.exec.vector.TimeStampVector
cannot be cast to org.apache.drill.exec.vector.VariableWidthVector while trying to read a
spark INT96 datetime field on Drill 1.11 in spite of setting the property store.parquet.reader.int96_as_timestamp
to  true.
> I believe this was fixed in drill 1.10(https://issues.apache.org/jira/browse/DRILL-4373).
What could be wrong.
> I have attached the dataset at https://github.com/rajrahul/files/blob/master/result.tar.gz

This message was sent by Atlassian JIRA

View raw message