carbondata-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "SWATI RAO (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (CARBONDATA-852) Less than or equal to operator(<=) does not work properly in Range Filter.
Date Wed, 17 May 2017 07:45:04 GMT

    [ https://issues.apache.org/jira/browse/CARBONDATA-852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16013681#comment-16013681
] 

SWATI RAO edited comment on CARBONDATA-852 at 5/17/17 7:44 AM:
---------------------------------------------------------------

[~vin7149]
 spark.sql("DROP TABLE IF EXISTS uniqdata")

    spark.sql("CREATE TABLE uniqdata (CUST_ID int,CUST_NAME String,ACTIVE_EMUI_VERSION string,
" +
              "DOB timestamp, DOJ timestamp, BIGINT_COLUMN1 bigint,BIGINT_COLUMN2 bigint,"
+
              "DECIMAL_COLUMN1 decimal(30,10), DECIMAL_COLUMN2 decimal(36,10),Double_COLUMN1
" +
              "double, Double_COLUMN2 double,INTEGER_COLUMN1 int) STORED BY 'org.apache" +
              ".carbondata.format' TBLPROPERTIES (\"TABLE_BLOCKSIZE\"= \"256 MB\")")

    spark.sql("LOAD DATA INPATH '/home/knoldus/Desktop/carbondata/carbondata/examples/spark2/src/main/resources/2000_UniqData.csv'
into table " +
              "uniqdata OPTIONS('DELIMITER'=',' , 'QUOTECHAR'='\"','BAD_RECORDS_ACTION'='FORCE',"
+
              "'FILEHEADER'='CUST_ID,CUST_NAME,ACTIVE_EMUI_VERSION,DOB,DOJ,BIGINT_COLUMN1,"
+
              "BIGINT_COLUMN2,DECIMAL_COLUMN1,DECIMAL_COLUMN2,Double_COLUMN1,Double_COLUMN2,"
+
              "INTEGER_COLUMN1')")

    spark.sql("select dob from uniqdata where dob <= '1972-12-10' and dob >= '1972-12-01'
").show

+--------------------+
|                 dob|
+--------------------+
|1972-12-01 01:00:...|
|1972-12-02 01:00:...|
|1972-12-03 01:00:...|
|1972-12-04 01:00:...|
|1972-12-05 01:00:...|
|1972-12-06 01:00:...|
|1972-12-07 01:00:...|
|1972-12-08 01:00:...|
|1972-12-09 01:00:...|
+--------------------+



was (Author: swati.rao):
[~vin7149]
 spark.sql("DROP TABLE IF EXISTS uniqdata")

    spark.sql("CREATE TABLE uniqdata (CUST_ID int,CUST_NAME String,ACTIVE_EMUI_VERSION string,
" +
              "DOB timestamp, DOJ timestamp, BIGINT_COLUMN1 bigint,BIGINT_COLUMN2 bigint,"
+
              "DECIMAL_COLUMN1 decimal(30,10), DECIMAL_COLUMN2 decimal(36,10),Double_COLUMN1
" +
              "double, Double_COLUMN2 double,INTEGER_COLUMN1 int) STORED BY 'org.apache" +
              ".carbondata.format' TBLPROPERTIES (\"TABLE_BLOCKSIZE\"= \"256 MB\")")

    spark.sql("LOAD DATA INPATH '/home/knoldus/Desktop/carbondata/carbondata/examples/spark2/src/main/resources/2000_UniqData.csv'
into table " +
              "uniqdata OPTIONS('DELIMITER'=',' , 'QUOTECHAR'='\"','BAD_RECORDS_ACTION'='FORCE',"
+
              "'FILEHEADER'='CUST_ID,CUST_NAME,ACTIVE_EMUI_VERSION,DOB,DOJ,BIGINT_COLUMN1,"
+
              "BIGINT_COLUMN2,DECIMAL_COLUMN1,DECIMAL_COLUMN2,Double_COLUMN1,Double_COLUMN2,"
+
              "INTEGER_COLUMN1')")

    spark.sql("select dob from uniqdata where dob <= '1972-12-10' and dob >= '1972-12-01'
").show

    spark.sql("select dob from uniqdata where dob <= '1972-12-10' and dob >= '1972-12-01'
").show


> Less than or equal to operator(<=) does not work properly in Range Filter.
> --------------------------------------------------------------------------
>
>                 Key: CARBONDATA-852
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-852
>             Project: CarbonData
>          Issue Type: Bug
>          Components: data-load
>    Affects Versions: 1.1.0
>         Environment: Spark 2-1
>            Reporter: Vinod Rohilla
>            Priority: Minor
>         Attachments: 2000_UniqData.csv
>
>
> Less than or equal (<=) to operator does not work properly in range filter.
> Steps to reproduces:
> 1)Create table:
> CREATE TABLE uniqdata (CUST_ID int,CUST_NAME String,ACTIVE_EMUI_VERSION string, DOB timestamp,
DOJ timestamp, BIGINT_COLUMN1 bigint,BIGINT_COLUMN2 bigint,DECIMAL_COLUMN1 decimal(30,10),
DECIMAL_COLUMN2 decimal(36,10),Double_COLUMN1 double, Double_COLUMN2 double,INTEGER_COLUMN1
int) STORED BY 'org.apache.carbondata.format' TBLPROPERTIES ("TABLE_BLOCKSIZE"= "256 MB");
> 2)Load Data in a table:
> LOAD DATA INPATH 'HDFS_URL/BabuStore/Data/uniqdata/2000_UniqData.csv' into table uniqdata
OPTIONS('DELIMITER'=',' , 'QUOTECHAR'='"','BAD_RECORDS_ACTION'='FORCE','FILEHEADER'='CUST_ID,CUST_NAME,ACTIVE_EMUI_VERSION,DOB,DOJ,BIGINT_COLUMN1,BIGINT_COLUMN2,DECIMAL_COLUMN1,DECIMAL_COLUMN2,Double_COLUMN1,Double_COLUMN2,INTEGER_COLUMN1');
> 3: Run the Query.
> select dob from uniqdata where dob <= '1972-12-10' and dob >= '1972-12-01';
> 4:Result on beeline:
> +------------------------+--+
> |          dob           |
> +------------------------+--+
> | 1972-12-01 01:00:03.0  |
> | 1972-12-02 01:00:03.0  |
> | 1972-12-03 01:00:03.0  |
> | 1972-12-04 01:00:03.0  |
> | 1972-12-05 01:00:03.0  |
> | 1972-12-06 01:00:03.0  |
> | 1972-12-07 01:00:03.0  |
> | 1972-12-08 01:00:03.0  |
> | 1972-12-09 01:00:03.0  |
> +------------------------+--+
> Expected Result: It should include " 1972-12-10 " in the result set.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message