Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 50702200BCE for ; Fri, 18 Nov 2016 06:38:05 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 4F32E160B18; Fri, 18 Nov 2016 05:38:05 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 98829160B0B for ; Fri, 18 Nov 2016 06:38:04 +0100 (CET) Received: (qmail 52859 invoked by uid 500); 18 Nov 2016 05:38:03 -0000 Mailing-List: contact issues-help@carbondata.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@carbondata.incubator.apache.org Delivered-To: mailing list issues@carbondata.incubator.apache.org Received: (qmail 52847 invoked by uid 99); 18 Nov 2016 05:38:03 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 18 Nov 2016 05:38:03 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 2D70F180BBA for ; Fri, 18 Nov 2016 05:38:03 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -6.219 X-Spam-Level: X-Spam-Status: No, score=-6.219 tagged_above=-999 required=6.31 tests=[KAM_ASCII_DIVIDERS=0.8, KAM_LAZY_DOMAIN_SECURITY=1, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RP_MATCHES_RCVD=-2.999] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id lrW9CuUi5fRh for ; Fri, 18 Nov 2016 05:38:01 +0000 (UTC) Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with SMTP id 55D005F472 for ; Fri, 18 Nov 2016 05:38:00 +0000 (UTC) Received: (qmail 52807 invoked by uid 99); 18 Nov 2016 05:37:59 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 18 Nov 2016 05:37:59 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id 871632C0059 for ; Fri, 18 Nov 2016 05:37:59 +0000 (UTC) Date: Fri, 18 Nov 2016 05:37:59 +0000 (UTC) From: "Raghunandan S (JIRA)" To: issues@carbondata.incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (CARBONDATA-417) [Bad Records] Not created and not writen log file when logger is True and action as Fail MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Fri, 18 Nov 2016 05:38:05 -0000 [ https://issues.apache.org/jira/browse/CARBONDATA-417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15675857#comment-15675857 ] Raghunandan S commented on CARBONDATA-417: ------------------------------------------ [~mraghuvardhan] pls check this.When behavior is fail why to log the same.It will fail the moment a bad record is encountered. > [Bad Records] Not created and not writen log file when logger is True and action as Fail > ---------------------------------------------------------------------------------------- > > Key: CARBONDATA-417 > URL: https://issues.apache.org/jira/browse/CARBONDATA-417 > Project: CarbonData > Issue Type: Bug > Components: data-load > Affects Versions: 0.1.1-incubating > Environment: 3 node Cluster > Reporter: MAKAMRAGHUVARDHAN > Priority: Minor > > Steps: > 1. Create Table: > CREATE TABLE truefail (ID int,CUST_ID int,cust_name string) STORED BY 'org.apache.carbondata.format'; > 2. Load Data having Logger as True and Action as False > LOAD DATA INPATH 'hdfs://hacluster/Raghu/test2.csv' into table truefail OPTIONS('DELIMITER'=',' , 'QUOTECHAR'='"','BAD_RECORDS_LOGGER_ENABLE'='TRUE', 'BAD_RECORDS_ACTION'='FAIL','FILEHEADER'='ID,CUST_ID,cust_name'); > 0: jdbc:hive2://ha-cluster/default> CREATE TABLE truefail (ID int,CUST_ID int,cust_name string) STORED BY 'org.apache.carbondata.format'; > +---------+--+ > | result | > +---------+--+ > +---------+--+ > No rows selected (0.679 seconds) > 0: jdbc:hive2://ha-cluster/default> LOAD DATA INPATH 'hdfs://hacluster/Raghu/test2.csv' into table truefail OPTIONS('DELIMITER'=',' , 'QUOTECHAR'='"','BAD_RECORDS_LOGGER_ENABLE'='TRUE', 'BAD_RECORDS_ACTION'='FAIL','FILEHEADER'='ID,CUST_ID,cust_name'); > Error: java.lang.Exception: DataLoad failure: Data load failed due to bad record ,The value "987654321010111213141516171819101122334455667788990012131415161718191909192939495969798" with column name CUST_ID and column data type INT is not a valid Record (state=,code=0) > 0: jdbc:hive2://ha-cluster/default> > Actual Result: Not Creating and not written log file for bad records when BAD_RECORDS_LOGGER_ENABLE'='TRUE', 'BAD_RECORDS_ACTION'='FAIL' > Expected Result: Should create and write log file when BAD_RECORDS_LOGGER_ENABLE'='TRUE', 'BAD_RECORDS_ACTION'='FAIL' for Bad records -- This message was sent by Atlassian JIRA (v6.3.4#6332)