carbondata-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sangeeta Gulia (JIRA)" <j...@apache.org>
Subject [jira] [Created] (CARBONDATA-1412) delete working incorrectly while using segment.starttime before '<any_date_value>'
Date Mon, 28 Aug 2017 12:17:00 GMT
Sangeeta Gulia created CARBONDATA-1412:
------------------------------------------

             Summary: delete working incorrectly while using segment.starttime before '<any_date_value>'
                 Key: CARBONDATA-1412
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-1412
             Project: CarbonData
          Issue Type: Bug
          Components: data-query, test
         Environment: Spark-2.1
            Reporter: Sangeeta Gulia
            Priority: Minor
             Fix For: 1.2.0


Issue exists in the below query :

delete from table uniqdata_delete where segment.starttime before 'starttime_of_last_segment_created';

It should mark all those segments for delete whose start-time is before the given time and
should not delete the segment with the given time.

But it is marking the segment for delete which is having the exact start time also.

To replicate the issue: 

CREATE TABLE uniqdata_delete (CUST_ID int,CUST_NAME String,ACTIVE_EMUI_VERSION string, DOB
timestamp, DOJ timestamp, BIGINT_COLUMN1 bigint,BIGINT_COLUMN2 bigint,DECIMAL_COLUMN1 decimal(30,10),
DECIMAL_COLUMN2 decimal(36,10),Double_COLUMN1 double, Double_COLUMN2 double, INTEGER_COLUMN1
int) STORED BY 'org.apache.carbondata.format' TBLPROPERTIES ("TABLE_BLOCKSIZE"= "256 MB")

LOAD DATA INPATH 'hdfs://localhost:54310/user/hduser/input-files/3000_UniqData.csv' into table
uniqdata_delete OPTIONS('FILEHEADER'='CUST_ID,CUST_NAME,ACTIVE_EMUI_VERSION,DOB,DOJ,BIGINT_COLUMN1,BIGINT_COLUMN2,DECIMAL_COLUMN1,DECIMAL_COLUMN2,Double_COLUMN1,Double_COLUMN2,INTEGER_COLUMN1')


LOAD DATA INPATH 'hdfs://localhost:54310/user/hduser/input-files/3000_UniqData.csv' into table
uniqdata_delete OPTIONS('FILEHEADER'='CUST_ID,CUST_NAME,ACTIVE_EMUI_VERSION,DOB,DOJ,BIGINT_COLUMN1,BIGINT_COLUMN2,DECIMAL_COLUMN1,DECIMAL_COLUMN2,Double_COLUMN1,Double_COLUMN2,INTEGER_COLUMN1')


delete from table uniqdata_delete where segment.starttime before 'starttime_of_last_segment_created';




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message