carbondata-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ramakrishna (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (CARBONDATA-646) Bad record handling is not correct for Int data type
Date Tue, 17 Jan 2017 09:39:26 GMT

     [ https://issues.apache.org/jira/browse/CARBONDATA-646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Ramakrishna updated CARBONDATA-646:
-----------------------------------
    Affects Version/s: 0.1.1-incubating
          Environment: Spark 1.6

> Bad record handling is not correct for Int data type
> ----------------------------------------------------
>
>                 Key: CARBONDATA-646
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-646
>             Project: CarbonData
>          Issue Type: Bug
>    Affects Versions: 0.1.1-incubating
>         Environment: Spark 1.6
>            Reporter: Ramakrishna
>            Priority: Minor
>
> With Bad record handling as default,
> If Char value is given for Int data type, that is handled properly(moving NULL).
> If Decimal values is given for Int Data type, it is stripping the decimal, where it should
consider this as bad record and move NULL.
> Bad record csv:
> TRUE,2.7,423.0,A,200000000003454300, 121.5,4.99,2.44,SE3423ee,asfdsffdfg,EtryTRWT,2012-01-12
03:14:05.123456729,2012-01-20
> 0: jdbc:hive2://172.168.100.212:23040> select * from t_carbn01 where qty_total is
NULL;
> +----------------+---------------+--------------+------------+---------------------+--------------+-----------------+---------+------------+-------------+--------------+------------------------+--------------+--+
> | active_status  | item_type_cd  | qty_day_avg  | qty_total  |     sell_price      |
sell_pricep  | discount_price  | profit  | item_code  |  item_name  | outlet_name  |     
update_time       | create_date  |
> +----------------+---------------+--------------+------------+---------------------+--------------+-----------------+---------+------------+-------------+--------------+------------------------+--------------+--+
> | TRUE           | 2             | 423          | NULL       | 200000000003454304  |
121.5        | 4.99            | 2.44    | SE3423ee   | asfdsffdfg  | EtryTRWT     | 2012-01-12
03:14:05.0  | 2012-01-20   |
> +----------------+---------------+--------------+------------+---------------------+--------------+-----------------+---------+------------+-------------+--------------+------------------------+----------
> 0: jdbc:hive2://172.168.100.212:23040> desc t_carbn01;
> +-----------------+---------------+----------+--+
> |    col_name     |   data_type   | comment  |
> +-----------------+---------------+----------+--+
> | active_status   | string        |          |
> | item_type_cd    | bigint        |          |
> | qty_day_avg     | bigint        |          |
> | qty_total       | bigint        |          |
> | sell_price      | bigint        |          |
> | sell_pricep     | double        |          |
> | discount_price  | double        |          |
> | profit          | decimal(3,2)  |          |
> | item_code       | string        |          |
> | item_name       | string        |          |
> | outlet_name     | string        |          |
> | update_time     | timestamp     |          |
> | create_date     | string        |          |
> +-----------------+---------------+----------+--+
>  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message