drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (DRILL-6016) Error reading INT96 created by Apache Spark
Date Thu, 29 Mar 2018 04:26:00 GMT

    [ https://issues.apache.org/jira/browse/DRILL-6016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16418423#comment-16418423
] 

ASF GitHub Bot commented on DRILL-6016:
---------------------------------------

Github user rajrahul commented on a diff in the pull request:

    https://github.com/apache/drill/pull/1166#discussion_r177950795
  
    --- Diff: exec/java-exec/src/test/java/org/apache/drill/exec/physical/impl/writer/TestParquetWriter.java
---
    @@ -797,6 +797,24 @@ public void testImpalaParquetBinaryAsTimeStamp_DictChange() throws
Exception {
         }
       }
     
    +  @Test
    +  public void testSparkParquetBinaryAsTimeStamp_DictChange() throws Exception {
    +    try {
    +      mockUtcDateTimeZone();
    --- End diff --
    
    @vdiravka your thoughts on comment above?


> Error reading INT96 created by Apache Spark
> -------------------------------------------
>
>                 Key: DRILL-6016
>                 URL: https://issues.apache.org/jira/browse/DRILL-6016
>             Project: Apache Drill
>          Issue Type: Bug
>         Environment: Drill 1.11
>            Reporter: Rahul Raj
>            Assignee: Rahul Raj
>            Priority: Major
>             Fix For: 1.14.0
>
>
> Hi,
> I am getting the error - SYSTEM ERROR : ClassCastException: org.apache.drill.exec.vector.TimeStampVector
cannot be cast to org.apache.drill.exec.vector.VariableWidthVector while trying to read a
spark INT96 datetime field on Drill 1.11 in spite of setting the property store.parquet.reader.int96_as_timestamp
to  true.
> I believe this was fixed in drill 1.10(https://issues.apache.org/jira/browse/DRILL-4373).
What could be wrong.
> I have attached the dataset at https://github.com/rajrahul/files/blob/master/result.tar.gz



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message