carbondata-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ravindra Pesala (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (CARBONDATA-1217) Failure in data load when we first load the bad record and then valid record and bad record action is set to Fail
Date Tue, 27 Jun 2017 07:44:00 GMT

     [ https://issues.apache.org/jira/browse/CARBONDATA-1217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Ravindra Pesala resolved CARBONDATA-1217.
-----------------------------------------
    Resolution: Fixed

> Failure in data load when we first load the bad record and then valid record and bad
record action is set to Fail
> -----------------------------------------------------------------------------------------------------------------
>
>                 Key: CARBONDATA-1217
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-1217
>             Project: CarbonData
>          Issue Type: Bug
>            Reporter: Manish Gupta
>            Assignee: Manish Gupta
>            Priority: Minor
>             Fix For: 1.2.0
>
>         Attachments: bigtabbad.csv, bigtab.csv
>
>          Time Spent: 1h 40m
>  Remaining Estimate: 0h
>
> When we load bad record into the table and bad record action is set to "FAIL", then data
load will fail. During load a bad record logger static map is maintained which holds the key
for bad record. When data load fails due to bad record exception is thrown and key from bad
record logger static map is not cleared because of which when valid data is loaded next time
data load fails because the key still exists in the map.
> Steps to reproduce
> -------------------------------
> Execute the below commands in sequence in the same session.
> create table bigtab (val string, bal int) STORED BY 'carbondata'
> load data  inpath 'bigtabbad.csv' into table bigtab options('DELIMITER'=',','QUOTECHAR'='"','BAD_RECORDS_ACTION'='FAIL','FILEHEADER'='val,bal')
> load data  inpath 'bigtab.csv' into table bigtab options('DELIMITER'=',','QUOTECHAR'='"','BAD_RECORDS_ACTION'='FAIL','FILEHEADER'='val,bal')



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message