Return-Path: X-Original-To: apmail-hive-dev-archive@www.apache.org Delivered-To: apmail-hive-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 14CF317600 for ; Thu, 16 Apr 2015 13:38:59 +0000 (UTC) Received: (qmail 77518 invoked by uid 500); 16 Apr 2015 13:38:58 -0000 Delivered-To: apmail-hive-dev-archive@hive.apache.org Received: (qmail 77441 invoked by uid 500); 16 Apr 2015 13:38:58 -0000 Mailing-List: contact dev-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list dev@hive.apache.org Received: (qmail 77425 invoked by uid 99); 16 Apr 2015 13:38:58 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 16 Apr 2015 13:38:58 +0000 Date: Thu, 16 Apr 2015 13:38:58 +0000 (UTC) From: "Chaoyu Tang (JIRA)" To: dev@hive.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Created] (HIVE-10362) Support Type check/conversion in dynamic partition column MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 Chaoyu Tang created HIVE-10362: ---------------------------------- Summary: Support Type check/conversion in dynamic partition column Key: HIVE-10362 URL: https://issues.apache.org/jira/browse/HIVE-10362 Project: Hive Issue Type: Improvement Components: Query Processor, Types Affects Versions: 1.0.0 Reporter: Chaoyu Tang Assignee: Chaoyu Tang There are quite a lot of issues associated with the non-noramlized or type-mismatched values for partition column. Hive has many ways to introduce such problematic data. HIVE-10307 mainly provides the support to type check/convert/normalize the partition column value in static partition specification. This JIRA tries to deal with the partition column type in dynamic partition insert. Currently any data can be inserted as a partition column value as long as it is quoted as a string. For example, create table dynparttypechecknum (key int, value string) partitioned by (part int); insert into dynparttypechecknum partition (part) select key, value, '00001' from src limit 1; show partitions dynparttypechecknum; -- part=00001 The partition column value is non-normalized int 00001. It causes some unnecessary problems such as integer partition column JDO filter pushdown (see HIVE-6052) and others like HIVE-10210. -- This message was sent by Atlassian JIRA (v6.3.4#6332)