hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chaoyu Tang (JIRA)" <>
Subject [jira] [Created] (HIVE-10362) Support Type check/conversion in dynamic partition column
Date Thu, 16 Apr 2015 13:38:58 GMT
Chaoyu Tang created HIVE-10362:

             Summary: Support Type check/conversion in dynamic partition column
                 Key: HIVE-10362
             Project: Hive
          Issue Type: Improvement
          Components: Query Processor, Types
    Affects Versions: 1.0.0
            Reporter: Chaoyu Tang
            Assignee: Chaoyu Tang

There are quite a lot of issues associated with the non-noramlized or type-mismatched values
for partition column. Hive has many ways to introduce such problematic data. HIVE-10307 mainly
provides the support to type check/convert/normalize the partition column value in static
partition specification. This JIRA tries to deal with the partition column type  in dynamic
partition insert. Currently any data can be inserted as a partition column value as long as
it is quoted as a string. For example,
create table dynparttypechecknum (key int, value string) partitioned by (part int);
insert into dynparttypechecknum partition (part) select key, value, '00001' from src limit
show partitions dynparttypechecknum;

The partition column value is non-normalized int 00001. It causes some unnecessary problems
such as integer partition column JDO filter pushdown (see HIVE-6052) and others like HIVE-10210.

This message was sent by Atlassian JIRA

View raw message