carbondata-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "MAKAMRAGHUVARDHAN (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CARBONDATA-417) [Bad Records] Not created and not writen log file when logger is True and action as Fail
Date Fri, 02 Dec 2016 10:26:58 GMT

    [ https://issues.apache.org/jira/browse/CARBONDATA-417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15714728#comment-15714728
] 

MAKAMRAGHUVARDHAN commented on CARBONDATA-417:
----------------------------------------------

As per current behavior, the issue is invalid,So closed this issue

> [Bad Records] Not created and not writen log file when logger is True and action as Fail
> ----------------------------------------------------------------------------------------
>
>                 Key: CARBONDATA-417
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-417
>             Project: CarbonData
>          Issue Type: Bug
>          Components: data-load
>    Affects Versions: 0.1.1-incubating
>         Environment: 3 node Cluster
>            Reporter: MAKAMRAGHUVARDHAN
>            Assignee: Akash R Nilugal
>            Priority: Minor
>
> Steps:
> 1. Create Table:
> CREATE TABLE truefail (ID int,CUST_ID int,cust_name string) STORED BY 'org.apache.carbondata.format';
> 2. Load Data having Logger as True and Action as False
> LOAD DATA INPATH 'hdfs://hacluster/Raghu/test2.csv' into table truefail OPTIONS('DELIMITER'=','
, 'QUOTECHAR'='"','BAD_RECORDS_LOGGER_ENABLE'='TRUE', 'BAD_RECORDS_ACTION'='FAIL','FILEHEADER'='ID,CUST_ID,cust_name');
> 0: jdbc:hive2://ha-cluster/default>  CREATE TABLE truefail (ID int,CUST_ID int,cust_name
string) STORED BY 'org.apache.carbondata.format';
> +---------+--+
> | result  |
> +---------+--+
> +---------+--+
> No rows selected (0.679 seconds)
> 0: jdbc:hive2://ha-cluster/default>  LOAD DATA INPATH 'hdfs://hacluster/Raghu/test2.csv'
into table truefail OPTIONS('DELIMITER'=',' , 'QUOTECHAR'='"','BAD_RECORDS_LOGGER_ENABLE'='TRUE',
'BAD_RECORDS_ACTION'='FAIL','FILEHEADER'='ID,CUST_ID,cust_name');
> Error: java.lang.Exception: DataLoad failure: Data load failed due to bad record ,The
value  "987654321010111213141516171819101122334455667788990012131415161718191909192939495969798"
with column name CUST_ID and column data type INT is not a valid Record (state=,code=0)
> 0: jdbc:hive2://ha-cluster/default>
> Actual Result: Not Creating and not written log file for bad records when BAD_RECORDS_LOGGER_ENABLE'='TRUE',
'BAD_RECORDS_ACTION'='FAIL'
> Expected Result: Should create and write log file when BAD_RECORDS_LOGGER_ENABLE'='TRUE',
'BAD_RECORDS_ACTION'='FAIL' for Bad records



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message