carbondata-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "sandeep purohit (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CARBONDATA-688) Select query displays wrong data for double datatype having null values
Date Fri, 03 Feb 2017 13:28:52 GMT

    [ https://issues.apache.org/jira/browse/CARBONDATA-688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15851484#comment-15851484
] 

sandeep purohit commented on CARBONDATA-688:
--------------------------------------------

We just create another simple table and filter null values but it is giving correct result
so the reason of bug is not to filter expression we need to check what is exact reason for
this bug

We follow below queries

  cc.sql("create table tabled (name String,age double) STORED BY 'org.apache.carbondata.format'")
  cc.sql("LOAD DATA INPATH '/home/sandy/try1.csv' INTO table tabled")
  cc.sql("select * from tabled").show()
  cc.sql("select * from tabled where age IS NOT NULL").show()
  cc.sql("select * from tabled where age IS NULL").show()

> Select query displays wrong data for double datatype having null values
> -----------------------------------------------------------------------
>
>                 Key: CARBONDATA-688
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-688
>             Project: CarbonData
>          Issue Type: Bug
>          Components: data-query
>    Affects Versions: 1.1.0-incubating
>         Environment: Spark 2.1
>            Reporter: Geetika Gupta
>            Priority: Minor
>         Attachments: 100_olap_C20.csv
>
>
> I tried to create a table having double as a column and load null values into that table.
When I performed the select query on the table, it is displaying wrong data.
> Below are the commands used:
> Create table :
> create table  Comp_VMALL_DICTIONARY_INCLUDE (imei string,deviceInformationId int,MAC
string,deviceColor string,device_backColor string,modelId string,marketName string,AMSize
string,ROMSize string,CUPAudit string,CPIClocked string,series string,productionDate timestamp,bomCode
string,internalModels string, deliveryTime string, channelsId string, channelsName string
, deliveryAreaId string, deliveryCountry string, deliveryProvince string, deliveryCity string,deliveryDistrict
string, deliveryStreet string, oxSingleNumber string, ActiveCheckTime string, ActiveAreaId
string, ActiveCountry string, ActiveProvince string, Activecity string, ActiveDistrict string,
ActiveStreet string, ActiveOperatorId string, Active_releaseId string, Active_EMUIVersion
string, Active_operaSysVersion string, Active_BacVerNumber string, Active_BacFlashVer string,
Active_webUIVersion string, Active_webUITypeCarrVer string,Active_webTypeDataVerNumber string,
Active_operatorsVersion string, Active_phonePADPartitionedVersions string, Latest_YEAR int,
Latest_MONTH int, Latest_DAY Decimal(30,10), Latest_HOUR string, Latest_areaId string, Latest_country
string, Latest_province string, Latest_city string, Latest_district string, Latest_street
string, Latest_releaseId string, Latest_EMUIVersion string, Latest_operaSysVersion string,
Latest_BacVerNumber string, Latest_BacFlashVer string, Latest_webUIVersion string, Latest_webUITypeCarrVer
string, Latest_webTypeDataVerNumber string, Latest_operatorsVersion string, Latest_phonePADPartitionedVersions
string, Latest_operatorId string, gamePointDescription string,gamePointId double,contractNumber
BigInt)  STORED BY 'org.apache.carbondata.format' TBLPROPERTIES('DICTIONARY_INCLUDE'='imei,deviceInformationId,productionDate,gamePointId,Latest_DAY,contractNumber');
> Load command:
> LOAD DATA INPATH  'hdfs://localhost:54311/BabuStore/DATA/100_olap_C20.csv' INTO table
Comp_VMALL_DICTIONARY_INCLUDE options ('DELIMITER'=',', 'QUOTECHAR'='"', 'BAD_RECORDS_ACTION'='FORCE','FILEHEADER'='imei,deviceInformationId,MAC,deviceColor,device_backColor,modelId,marketName,AMSize,ROMSize,CUPAudit,CPIClocked,series,productionDate,bomCode,internalModels,deliveryTime,channelsId,channelsName,deliveryAreaId,deliveryCountry,deliveryProvince,deliveryCity,deliveryDistrict,deliveryStreet,oxSingleNumber,contractNumber,ActiveCheckTime,ActiveAreaId,ActiveCountry,ActiveProvince,Activecity,ActiveDistrict,ActiveStreet,ActiveOperatorId,Active_releaseId,Active_EMUIVersion,Active_operaSysVersion,Active_BacVerNumber,Active_BacFlashVer,Active_webUIVersion,Active_webUITypeCarrVer,Active_webTypeDataVerNumber,Active_operatorsVersion,Active_phonePADPartitionedVersions,Latest_YEAR,Latest_MONTH,Latest_DAY,Latest_HOUR,Latest_areaId,Latest_country,Latest_province,Latest_city,Latest_district,Latest_street,Latest_releaseId,Latest_EMUIVersion,Latest_operaSysVersion,Latest_BacVerNumber,Latest_BacFlashVer,Latest_webUIVersion,Latest_webUITypeCarrVer,Latest_webTypeDataVerNumber,Latest_operatorsVersion,Latest_phonePADPartitionedVersions,Latest_operatorId,gamePointId,gamePointDescription');
> Select query:
> select gamePointId  from Comp_VMALL_DICTIONARY_INCLUDE where gamePointId IS NOT NULL
order by gamePointId;
> select gamePointId from Comp_VMALL_DICTIONARY_INCLUDE where gamePointId is NULL;
> The first select command displays null values as well and the second command displays
no values.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message