carbondata-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "sounak chakraborty (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CARBONDATA-610) Update is working with String Datatype now but Date Datatype still not working
Date Tue, 17 Jan 2017 09:23:26 GMT

    [ https://issues.apache.org/jira/browse/CARBONDATA-610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15825699#comment-15825699
] 

sounak chakraborty commented on CARBONDATA-610:
-----------------------------------------------

The Default Timestamp format of carbondata is yyyy-MM-dd HH:mm:ss. In case of any deviation
it will be considered as Bad Records. And if Bad Records Action is Force then Null will be
placed in the column. 

The value set for dob column is not according to the format therefore Null is placed in case
of update. 
update uniqdata set (dob)=('2016-12-11') where cust_name = 'CUST_NAME_01999';

Change the query to below format and check again. 
update uniqdata set (dob)=('2016-12-11 02:02:02') where cust_name = 'CUST_NAME_01999';

0: jdbc:hive2://localhost:10000> update uniqdata_charq set (dob)=('2016-12-11 02:00:03')
where cust_name = 'CUST_NAME_01999';
+---------+--+| Result  |
+---------+--+
+---------+--+
No rows selected (3.993 seconds)
0: jdbc:hive2://localhost:10000> select dob, doj from uniqdata_charq where cust_name =
'CUST_NAME_01999';
+------------------------+------------------------+--+|          dob           |         
doj           |
+------------------------+------------------------+--+
| 2016-12-11 02:00:03.0  | 1975-06-23 02:00:03.0  |
| 2016-12-11 02:00:03.0  | 1975-06-23 02:00:03.0  |
| 2016-12-11 02:00:03.0  | 1975-06-23 02:00:03.0  |
| 2016-12-11 02:00:03.0  | 1975-06-23 02:00:03.0  |
| 2016-12-11 02:00:03.0  | 1975-06-23 02:00:03.0  |
+------------------------+------------------------+--+




> Update is working with String Datatype now but Date Datatype still not working
> ------------------------------------------------------------------------------
>
>                 Key: CARBONDATA-610
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-610
>             Project: CarbonData
>          Issue Type: Bug
>          Components: data-query
>    Affects Versions: 1.0.0-incubating
>         Environment: SPARK=1.6
>            Reporter: abhishek giri
>            Assignee: sounak chakraborty
>         Attachments: 3000_UniqData.csv, Screenshot from 2017-01-10 12-32-48.png
>
>
> Update query is not working with spark 1.6 and String and date
> Create Table Query = CREATE TABLE uniqdata (CUST_ID int,CUST_NAME String,ACTIVE_EMUI_VERSION
string, DOB timestamp, DOJ timestamp, BIGINT_COLUMN1 bigint,BIGINT_COLUMN2 bigint,DECIMAL_COLUMN1
decimal(30,10), DECIMAL_COLUMN2 decimal(36,10),Double_COLUMN1 double, Double_COLUMN2 double,INTEGER_COLUMN1
int) STORED BY 'org.apache.carbondata.format' TBLPROPERTIES ("TABLE_BLOCKSIZE"= "256 MB");
> Load data query = LOAD DATA INPATH 'hdfs://localhost:54310/tmp/testData/3000_UniqData.csv'
into table uniqdata OPTIONS('FILEHEADER'='CUST_ID,CUST_NAME,ACTIVE_EMUI_VERSION,DOB,DOJ,BIGINT_COLUMN1,BIGINT_COLUMN2,DECIMAL_COLUMN1,DECIMAL_COLUMN2,Double_COLUMN1,Double_COLUMN2,INTEGER_COLUMN1');
>  
> Query for String = update uniqdata set (CUST_NAME)=('tony stark');
> Query for Date = update uniqdata set (dob)=('2016-12-11') where cust_name = 'CUST_NAME_01999';
> After update NULL is being inserted as shown below: 
> ---------------------+-------------------------+----------------------+-----------------------+------------------+--+
> | cust_id  | cust_name  |    active_emui_version     |          dob           |     
    doj           | bigint_column1  | bigint_column2  |     decimal_column1     |     decimal_column2
    |    double_column1    |    double_column2     | integer_column1  |
> +----------+------------+----------------------------+------------------------+------------------------+-----------------+-----------------+-------------------------+-------------------------+----------------------+-----------------------+------------------+--+
> | 10987    | NULL       | ACTIVE_EMUI_VERSION_01987  | 1975-06-11 01:00:03.0  | 1975-06-11
02:00:03.0  | 123372038841    | -223372034867   | 12345.6808882656        | 22345.6808882656
       | 1.12345674897976E10  | -1.12345674897976E10  | 1988             |
> | 10988    | NULL       | ACTIVE_EMUI_VERSION_01988  | 1975-06-12 01:00:03.0  | 1975-06-12
02:00:03.0  | 123372038842    | -223372034866   | 12345.6808892656        | 22345.6808892656
       | 1.12345674897976E10  | -1.12345674897976E10  | 1989             |
> | 10989    | NULL       | ACTIVE_EMUI_VERSION_01989  | 1975-06-13 01:00:03.0  | 1975-06-13
02:00:03.0  | 123372038843    | -223372034865   | 12345.6808902656        | 22345.6808902656
       | 1.12345674897976E10  | -1.12345674897976E10  | 1990             |
> | 10990    | NULL       | ACTIVE_EMUI_VERSION_01990  | 1975-06-14 01:00:03.0  | 1975-06-14
02:00:03.0  | 123372038844    | -223372034864   | 12345.6808912656        | 22345.6808912656
       | 1.12345674897976E10  | -1.12345674897976E10  | 1991             |
> | 10991    | NULL       | ACTIVE_EMUI_VERSION_01991  | 1975-06-15 01:00:03.0  | 1975-06-15
02:00:03.0  | 123372038845    | -223372034863   | 12345.6808922656        | 22345.6808922656
       | 1.12345674897976E10  | -1.12345674897976E10  | 1992             |
> | 10992    | NULL       | ACTIVE_EMUI_VERSION_01992  | 1975-06-16 01:00:03.0  | 1975-06-16
02:00:03.0  | 123372038846    | -223372034862   | 12345.6808932656        | 22345.6808932656
       | 1.12345674897976E10  | -1.12345674897976E10  | 1993             |
> | 10993    | NULL       | ACTIVE_EMUI_VERSION_01993  | 1975-06-17 01:00:03.0  | 1975-06-17
02:00:03.0  | 123372038847    | -223372034861   | 12345.6808942656        | 22345.6808942656
       | 1.12345674897976E10  | -1.12345674897976E10  | 1994             |
> | 10994    | NULL       | ACTIVE_EMUI_VERSION_01994  | 1975-06-18 01:00:03.0  | 1975-06-18
02:00:03.0  | 123372038848    | -223372034860   | 12345.6808952656        | 22345.6808952656
       | 1.12345674897976E10  | -1.12345674897976E10  | 1995             |
> | 10995    | NULL       | ACTIVE_EMUI_VERSION_01995  | 1975-06-19 01:00:03.0  | 1975-06-19
02:00:03.0  | 123372038849    | -223372034859   | 12345.6808962656        | 22345.6808962656
       | 1.12345674897976E10  | -1.12345674897976E10  | 1996             |
> | 10996    | NULL       | ACTIVE_EMUI_VERSION_01996  | 1975-06-20 01:00:03.0  | 1975-06-20
02:00:03.0  | 123372038850    | -223372034858   | 12345.6808972656        | 22345.6808972656
       | 1.12345674897976E10  | -1.12345674897976E10  | 1997             |
> | 10997    | NULL       | ACTIVE_EMUI_VERSION_01997  | 1975-06-21 01:00:03.0  | 1975-06-21
02:00:03.0  | 123372038851    | -223372034857   | 12345.6808982656        | 22345.6808982656
       | 1.12345674897976E10  | -1.12345674897976E10  | 1998             |
> | 10998    | NULL       | ACTIVE_EMUI_VERSION_01998  | 1975-06-22 01:00:03.0  | 1975-06-22
02:00:03.0  | 123372038852    | -223372034856   | 12345.6808992656        | 22345.6808992656
       | 1.12345674897976E10  | -1.12345674897976E10  | 1999             |
> +----------+------------+----------------------------+------------------------+------------------------+-----------------+-----------------+-------------------------+-------------------------+----------------------+-----------------------+------------------+--+
> For Date snapshot is attached



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message