drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Venki Korukanti (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (DRILL-521) INFORMATION_SCHEMA breaks if you have hive table with unsupported datatypes
Date Wed, 11 Jun 2014 21:27:01 GMT

     [ https://issues.apache.org/jira/browse/DRILL-521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Venki Korukanti updated DRILL-521:
----------------------------------

    Attachment: DRILL-521-1.patch

1. Refactored code: Instead of converting two forms of Hive types info (string and ObjectInspector),
switch to using only one form of type info i.e hive TypeInfo.
2. Add missing mappings of Hive data type to Sql data type.

> INFORMATION_SCHEMA breaks if you have hive table with unsupported datatypes
> ---------------------------------------------------------------------------
>
>                 Key: DRILL-521
>                 URL: https://issues.apache.org/jira/browse/DRILL-521
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Metadata
>            Reporter: Ramana Inukonda Nagaraj
>            Assignee: Venki Korukanti
>             Fix For: 1.0.0-BETA1
>
>         Attachments: DRILL-521-1.patch
>
>
> repro:
> Create some hive tables having datatypes which are valid in drill. Ie no struct, arrays
etc. 
> Select * from INFORMATION_SCHEMA.TABLES works at this point.
> Create a hive table containing complex data types: Example:
> CREATE TABLE test_serializer(string1 STRING,
>                              int1 INT,
>                              tinyint1 TINYINT,
>                              smallint1 SMALLINT,
>                              bigint1 BIGINT,
>                              boolean1 BOOLEAN,
>                              float1 FLOAT,
>                              double1 DOUBLE,
>                              list1 ARRAY<STRING>,
>                              map1 MAP<STRING,INT>,
>                              struct1 STRUCT<sint:INT,sboolean:BOOLEAN,sstring:STRING>,
>                              enum1 STRING,
>                              nullableint INT,
>                              bytes1 BINARY,
>                              fixed1 BINARY)
>  ROW FORMAT DELIMITED FIELDS TERMINATED BY ',' COLLECTION ITEMS TERMINATED BY ':' MAP
KEYS TERMINATED BY '#' LINES TERMINATED BY '\n'
>  STORED AS TEXTFILE;
> After this INFORMATION_SCHEMA queries fail  with 
> message: "Failure while parsing sql. < ValidationException:[ java.lang.RuntimeException:
Unknown or unsupported hive type ] < RuntimeException:[ Unknown or unsupported hive type
]"



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message