From issues-return-34478-archive-asf-public=cust-asf.ponee.io@carbondata.apache.org Mon Feb 5 11:45:05 2018 Return-Path: X-Original-To: archive-asf-public@eu.ponee.io Delivered-To: archive-asf-public@eu.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by mx-eu-01.ponee.io (Postfix) with ESMTP id 724E5180647 for ; Mon, 5 Feb 2018 11:45:05 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 620AC160C46; Mon, 5 Feb 2018 10:45:05 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id A9DDD160C4B for ; Mon, 5 Feb 2018 11:45:04 +0100 (CET) Received: (qmail 31962 invoked by uid 500); 5 Feb 2018 10:45:03 -0000 Mailing-List: contact issues-help@carbondata.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@carbondata.apache.org Delivered-To: mailing list issues@carbondata.apache.org Received: (qmail 31953 invoked by uid 99); 5 Feb 2018 10:45:03 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 05 Feb 2018 10:45:03 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 49B001803CE for ; Mon, 5 Feb 2018 10:45:03 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -110.311 X-Spam-Level: X-Spam-Status: No, score=-110.311 tagged_above=-999 required=6.31 tests=[ENV_AND_HDR_SPF_MATCH=-0.5, RCVD_IN_DNSWL_MED=-2.3, SPF_PASS=-0.001, T_RP_MATCHES_RCVD=-0.01, USER_IN_DEF_SPF_WL=-7.5, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id k4ziWgiIRWcj for ; Mon, 5 Feb 2018 10:45:02 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTP id 4EC395F2AB for ; Mon, 5 Feb 2018 10:45:01 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 940F2E0114 for ; Mon, 5 Feb 2018 10:45:00 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 4F40821E83 for ; Mon, 5 Feb 2018 10:45:00 +0000 (UTC) Date: Mon, 5 Feb 2018 10:45:00 +0000 (UTC) From: "Vandana Yadav (JIRA)" To: issues@carbondata.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Created] (CARBONDATA-2132) Error while loading data with insert overwrite in partitioned table MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 Vandana Yadav created CARBONDATA-2132: ----------------------------------------- Summary: Error while loading data with insert overwrite in par= titioned table Key: CARBONDATA-2132 URL: https://issues.apache.org/jira/browse/CARBONDATA-2132 Project: CarbonData Issue Type: Bug Components: data-load Affects Versions: 1.3.0 Reporter: Vandana Yadav Attachments: 2000_UniqData.csv error while loading data with insert overwrite in partitioned table Steps to Reproduce: 1) Create a hive table: CREATE TABLE uniqdata_hive (CUST_ID int,CUST_NAME String,ACTIVE_EMUI_VERSIO= N string, DOB timestamp, DOJ timestamp, BIGINT_COLUMN1 bigint,BIGINT_COLUMN= 2 bigint,DECIMAL_COLUMN1 decimal(30,10), DECIMAL_COLUMN2 decimal(36,10),Dou= ble_COLUMN1 double, Double_COLUMN2 double, INTEGER_COLUMN1 int)ROW FORMAT D= ELIMITED FIELDS TERMINATED BY ',' Load data into the table: LOAD DATA LOCAL INPATH '/opt/Carbon/CarbonData/TestData/Data/uniqdata/2000_= UniqData.csv' into table UNIQDATA_HIVE 2) Create Carbon table: CREATE TABLE uniqdata_string(CUST_NAME String,ACTIVE_EMUI_VERSION string,DO= B timestamp,DOJ timestamp, BIGINT_COLUMN1 bigint,BIGINT_COLUMN2 bigint,DECI= MAL_COLUMN1 decimal(30,10),DECIMAL_COLUMN2 decimal(36,10),Double_COLUMN1 do= uble, Double_COLUMN2 double,INTEGER_COLUMN1 int) PARTITIONED BY(CUST_ID int= ) STORED BY 'org.apache.carbondata.format' TBLPROPERTIES ('TABLE_BLOCKSIZE'= =3D '256 MB') Load data into the table: LOAD DATA INPATH 'HDFS_URL/BabuStore/Data/uniqdata/2000_UniqData.csv' into = table uniqdata_string partition(CUST_ID=3D'1111') OPTIONS('FILEHEADER'=3D'C= UST_ID,CUST_NAME ,ACTIVE_EMUI_VERSION,DOB,DOJ, BIGINT_COLUMN1,BIGINT_COLUMN= 2,DECIMAL_COLUMN1,DECIMAL_COLUMN2,Double_COLUMN1, Double_COLUMN2,INTEGER_CO= LUMN1','BAD_RECORDS_ACTION'=3D'FORCE') 3) Execute insert overwrite query: a) insert overwrite table uniqdata_string partition(CUST_ID=3D'0000') selec= t CUST_NAME,ACTIVE_EMUI_VERSION,DOB,doj, bigint_column1, bigint_column2, de= cimal_column1, decimal_column2,double_column1, double_column2,integer_colum= n1 from uniqdata_hive limit 10 Actual Output:=C2=A0 Error: org.apache.spark.sql.AnalysisException: Partition spec is invalid. T= he spec (CUST_ID) must be contained within the partition spec (cust_id) def= ined in table '`bug`.`uniqdata_string`'; (state=3D,code=3D0) b)=C2=A0insert overwrite table uniqdata_string partition(cust_id=3D'3333') = select CUST_NAME,ACTIVE_EMUI_VERSION,DOB,doj, bigint_column1, bigint_column= 2, decimal_column1, decimal_column2,double_column1, double_column2,integer_= column1 from uniqdata_hive limit 10 Actual Output: =C2=A0+---------+--+ | Result | +---------+--+ +---------+--+ No rows selected (2.551 seconds) Expected Output: data should be inserted successfully in both case.(partiti= on spec should be case insensitive) -- This message was sent by Atlassian JIRA (v7.6.3#76005)