carbondata-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Liang Chen (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CARBONDATA-639) "Delete data" feature doesn't work
Date Mon, 16 Jan 2017 06:48:27 GMT

    [ https://issues.apache.org/jira/browse/CARBONDATA-639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15823537#comment-15823537
] 

Liang Chen commented on CARBONDATA-639:
---------------------------------------

Version: CarbonData is the latest master + Spark 1.6.2

go to SPARK_HOME, start up spark-shell: 
spark-shell with command : ./bin/spark-shell --master local --jars ${carbondata_jar},${mysql_jar}
    (note:need to configure mysql as metadata database)

Create table
cc.sql(“CREATE TABLE connectdemo1 (name String, gender String, province String , singler
String, age Int) STORED BY ‘org.apache.carbondata.format’”)
(you can simulate data as per the below)
Abbott	Female	AB	false	54
Abbott	Female	AB	false	51
Abbott	Female	AB	false	65
Abbott	Female	AB	false	47
Abbott	Female	AB	false	56
Abbott	Female	AB	false	54
Abbott	Female	AB	false	61
Abbott	Female	AB	false	58
Abbott	Female	AB	false	62
Abbott	Female	AB	false	47
Abbott	Female	AB	false	49
Abbott	Female	AB	false	53
Abbott	Female	AB	false	63
Abbott	Female	AB	false	48
Abbott	Female	AB	false	52
Abbott	Female	AB	false	52
Abbott	Female	AB	false	62
Abbott	Female	AB	false	61
Abbott	Female	AB	false	63
Abbott	Female	AB	false	49


cc.sql(“LOAD DATA LOCAL INPATH ‘csv file data’”)



> "Delete data" feature doesn't work
> ----------------------------------
>
>                 Key: CARBONDATA-639
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-639
>             Project: CarbonData
>          Issue Type: Bug
>          Components: core
>    Affects Versions: 1.0.0-incubating
>            Reporter: Liang Chen
>            Assignee: sounak chakraborty
>             Fix For: 1.0.0-incubating
>
>
> 1.Version:CarbonData is the latest master , Spark 1.6.2
> 2.Test Environment: spark-shell with command of ./bin/spark-shell --master local --jars
${carbondata_jar},${mysql_jar}
> 3.Reproduce steps:
> 1.Finish load data , query as below : cc.sql("select * from connectdemo1 where age >
40").show() :
> +------+------+--------+-------+---+
> |  name|gender|province|singler|age|
> +------+------+--------+-------+---+
> |Abbott|Female|      AB|  false| 54|
> |Abbott|Female|      AB|  false| 51|
> |Abbott|Female|      AB|  false| 65|
> |Abbott|Female|      AB|  false| 47|
> |Abbott|Female|      AB|  false| 56|
> |Abbott|Female|      AB|  false| 54|
> |Abbott|Female|      AB|  false| 61|
> |Abbott|Female|      AB|  false| 58|
> |Abbott|Female|      AB|  false| 62|
> |Abbott|Female|      AB|  false| 47|
> |Abbott|Female|      AB|  false| 49|
> |Abbott|Female|      AB|  false| 53|
> |Abbott|Female|      AB|  false| 63|
> |Abbott|Female|      AB|  false| 48|
> |Abbott|Female|      AB|  false| 52|
> |Abbott|Female|      AB|  false| 52|
> |Abbott|Female|      AB|  false| 62|
> |Abbott|Female|      AB|  false| 61|
> |Abbott|Female|      AB|  false| 63|
> |Abbott|Female|      AB|  false| 49|
> +------+------+--------+-------+---+
> cc.sql("select count(*) from connectdemo1").show()
> +-------+
> |    _c0|
> +-------+
> |9000000|
> +-------+
> 2.cc.sql("delete from connectdemo1 where age > 60").show
> 3.query again with cc.sql("select * from connectdemo1 where age > 40").show() and
cc.sql("select count(*) from connectdemo1").show()  : same result with before deletion , so
the delete operation is failed.
> +------+------+--------+-------+---+
> |  name|gender|province|singler|age|
> +------+------+--------+-------+---+
> |Abbott|Female|      AB|  false| 54|
> |Abbott|Female|      AB|  false| 51|
> |Abbott|Female|      AB|  false| 65|
> |Abbott|Female|      AB|  false| 47|
> |Abbott|Female|      AB|  false| 56|
> |Abbott|Female|      AB|  false| 54|
> |Abbott|Female|      AB|  false| 61|
> |Abbott|Female|      AB|  false| 58|
> |Abbott|Female|      AB|  false| 62|
> |Abbott|Female|      AB|  false| 47|
> |Abbott|Female|      AB|  false| 49|
> |Abbott|Female|      AB|  false| 53|
> |Abbott|Female|      AB|  false| 63|
> |Abbott|Female|      AB|  false| 48|
> |Abbott|Female|      AB|  false| 52|
> |Abbott|Female|      AB|  false| 52|
> |Abbott|Female|      AB|  false| 62|
> |Abbott|Female|      AB|  false| 61|
> |Abbott|Female|      AB|  false| 63|
> |Abbott|Female|      AB|  false| 49|
> +------+------+--------+-------+---+
> +-------+
> |    _c0|
> +-------+
> |9000000|
> +-------+



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message