carbondata-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "dylan (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (CARBONDATA-1484) carbonthriftserver cache is not refreshed
Date Mon, 18 Sep 2017 10:11:00 GMT

     [ https://issues.apache.org/jira/browse/CARBONDATA-1484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

dylan updated CARBONDATA-1484:
------------------------------
    External issue URL: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/Fw-carbonthriftserver-can-not-be-load-many-times-td21823.html

> carbonthriftserver cache is not refreshed
> -----------------------------------------
>
>                 Key: CARBONDATA-1484
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-1484
>             Project: CarbonData
>          Issue Type: Bug
>          Components: core
>    Affects Versions: 1.1.0
>         Environment: spark:1.6.0,mysql hive metastore
>            Reporter: dylan
>             Fix For: NONE
>
>
>   i am use carbondata version is 1.1.0 and spark version is 1.6.0. 
>     and I reproduce in accordance with the official quick-start-guide case 
> again, 
>     1.Creating a Table 
> cc.sql("create table IF NOT EXISTS  carbondb.test_table(id string,name 
> String,city String,age int) stored by 'carbondata' ") 
>     2.load data into table 
>   cc.sql("load data inpath 'hdfs://nameservice1/user/zz/sample.csv' into 
> table carbondb.test_table") 
>     3.start carbonthriftserver 
>    /home/zz/spark-1.6.0-bin-hadoop2.6/bin/spark-submit  --master local[*] 
> --driver-java-options="-Dcarbon.properties.filepath=/home/zz/spark-1.6.0-bin-hadoop2.6/conf/carbon.properties"

> --executor-memory 4G  --driver-memory 2g  --conf 
> spark.serializer=org.apache.spark.serializer.KryoSerializer   --conf 
> "spark.sql.shuffle.partitions=3" --conf spark.speculation=true   --class 
> org.apache.carbondata.spark.thriftserver.CarbonThriftServer 
> /home/zz/spark-1.6.0-bin-hadoop2.6/carbonlib/carbondata_2.10-1.1.0-shade-hadoop2.2.0.jar

> hdfs://nameservice1/user/zz/rp_carbon_store 
>    4.Connecting to CarbonData Thrift Server Using Beeline. 
>          <http://chuantu.biz/t6/47/1505284993x2890202558.jpg> 
>    5.drop table 
>    cc.sql("drop table carbondb.test_table") 
>    6.recreate table and load data 
>     cc.sql("create table IF NOT EXISTS  carbondb.test_table(id string,name 
> String,city String,age int) stored by 'carbondata' ") 
>     cc.sql("load data inpath 'hdfs://nameservice1/user/zz/sample.csv' into 
> table carbondb.test_table") 
>    7.select data use beeline 
>     <http://chuantu.biz/t6/47/1505284937x1034817476.jpg> 
>    Like the above error, the cache is not updated 
>  in my case,1,2,5 and 6 step is one session on spark-shell ,4 and 7 is 
> one session on beeline, 
> and i test this case on the current carbondata master branch(1.2.0), 
>  when i use beeline there is no Btree load failed info,but in my table there 
> is no data,All the data is null,but in spark-shell is ok. 
> spark-shell: 
> +---+-----+--------+---+ 
> | id| name|    city|age| 
> +---+-----+--------+---+ 
> |  1|david|shenzhen| 31| 
> |  2|eason|shenzhen| 27| 
> |  3|jarry|   wuhan| 35| 
> +---+-----+--------+---+ 
> beeline: 
> 0: jdbc:hive2://localhost:10000> select * from  carbondb.test_table; 
> +-------+-------+-------+-------+--+ 
> |  id   | name  | city  |  age  | 
> +-------+-------+-------+-------+--+ 
> | NULL  | NULL  | NULL  | NULL  | 
> | NULL  | NULL  | NULL  | NULL  | 
> | NULL  | NULL  | NULL  | NULL  | 
> +-------+-------+-------+-------+--+ 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message