drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jacques Nadeau (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (DRILL-4156) Parquet group converter cannot cope with ENUM original type values
Date Fri, 04 Dec 2015 17:23:10 GMT

    [ https://issues.apache.org/jira/browse/DRILL-4156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15041797#comment-15041797
] 

Jacques Nadeau commented on DRILL-4156:
---------------------------------------

Can you add a test? Also, it would be good if you had tests for both parquet readers (we should
make sure they both work with ENUM).

thanks!

> Parquet group converter cannot cope with ENUM original type values 
> -------------------------------------------------------------------
>
>                 Key: DRILL-4156
>                 URL: https://issues.apache.org/jira/browse/DRILL-4156
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Storage - Parquet
>    Affects Versions: 1.3.0, 1.4.0
>            Reporter: Chris Jansen
>              Labels: easyfix, newbie, patch
>         Attachments: parquet_enum.patch, parquet_enum_v2.patch
>
>
> When importing parquet data written using a Thrift schema, Drill cannot cope with ENUMs.
This was fixed elsewhere in DRILL-1775 but not in the DrillParquetGroupConverter class ([see
mailing list thread|https://mail-archives.apache.org/mod_mbox/drill-user/201508.mbox/%3CCAK55V=+VjPAehMiJ8U=CRH182k4zvhGfxzfwzNaA9edWZWgXKg@mail.gmail.com%3E]).
> It appears that the ParquetToDrillTypeConverter class was updated to use a varbinary
as it's default behaviour, but the DrillParquetGroupConverter class was not updated to do
the same. 
> {code}
> Caused by: java.lang.UnsupportedOperationException: Unsupported type ENUM
> 	at org.apache.drill.exec.store.parquet2.DrillParquetGroupConverter.getConverterForType(DrillParquetGroupConverter.java:249)
> 	at org.apache.drill.exec.store.parquet2.DrillParquetGroupConverter.<init>(DrillParquetGroupConverter.java:154)
> 	at org.apache.drill.exec.store.parquet2.DrillParquetGroupConverter.<init>(DrillParquetGroupConverter.java:147)
> 	at org.apache.drill.exec.store.parquet2.DrillParquetGroupConverter.<init>(DrillParquetGroupConverter.java:147)
> 	at org.apache.drill.exec.store.parquet2.DrillParquetGroupConverter.<init>(DrillParquetGroupConverter.java:147)
> 	at org.apache.drill.exec.store.parquet2.DrillParquetRecordMaterializer.<init>(DrillParquetRecordMaterializer.java:40)
> 	at org.apache.drill.exec.store.parquet2.DrillParquetReader.setup(DrillParquetReader.java:267)
> 	... 14 more
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message