hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chaoyu Tang (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HIVE-10362) Support Type check/conversion in dynamic partition column
Date Thu, 16 Apr 2015 13:38:58 GMT
Chaoyu Tang created HIVE-10362:
----------------------------------

             Summary: Support Type check/conversion in dynamic partition column
                 Key: HIVE-10362
                 URL: https://issues.apache.org/jira/browse/HIVE-10362
             Project: Hive
          Issue Type: Improvement
          Components: Query Processor, Types
    Affects Versions: 1.0.0
            Reporter: Chaoyu Tang
            Assignee: Chaoyu Tang


There are quite a lot of issues associated with the non-noramlized or type-mismatched values
for partition column. Hive has many ways to introduce such problematic data. HIVE-10307 mainly
provides the support to type check/convert/normalize the partition column value in static
partition specification. This JIRA tries to deal with the partition column type  in dynamic
partition insert. Currently any data can be inserted as a partition column value as long as
it is quoted as a string. For example,
create table dynparttypechecknum (key int, value string) partitioned by (part int);
insert into dynparttypechecknum partition (part) select key, value, '00001' from src limit
1;
show partitions dynparttypechecknum;
--
part=00001

The partition column value is non-normalized int 00001. It causes some unnecessary problems
such as integer partition column JDO filter pushdown (see HIVE-6052) and others like HIVE-10210.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message