carbondata-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ravindra Pesala (JIRA)" <>
Subject [jira] [Commented] (CARBONDATA-644) Select query fails randomly on spark shell
Date Mon, 16 Jan 2017 16:42:26 GMT


Ravindra Pesala commented on CARBONDATA-644:

I think you have configured  "fs.defaultFS" in your conf/ *.xml files. If you configure this
parameter as hdfs then it always look this path into hadoop file system. Please verify it

> Select query fails randomly on spark shell
> ------------------------------------------
>                 Key: CARBONDATA-644
>                 URL:
>             Project: CarbonData
>          Issue Type: Bug
>          Components: data-query
>    Affects Versions: 1.0.0-incubating
>         Environment: spark 1.6.2
>            Reporter: Deepti Bhardwaj
>            Assignee: Ravindra Pesala
>            Priority: Minor
>         Attachments: connectdemo1.csv, eror-log-while-select
> I created a carbon table and loaded it with data(csv attached) via spark shell by running
the below command from $SPARK_HOME/bin :
> ./spark-shell
> and then to get the carbon context :
> import org.apache.spark.sql.CarbonContext; 
> val cc = new CarbonContext(sc); 
> scala>cc.sql("CREATE TABLE connectdemo1 (name String, gender String, province String
, singler String, age Int) STORED BY 'org.apache.carbondata.format'");
> scala>cc.sql("LOAD DATA inpath 'hdfs://localhost:54310/BabuStore/Data/uniqdata/connectdemo1.csv'
INTO table connectdemo1 options('DELIMITER'=',','FILEHEADER'='name, gender, province, singler,
> The above two operations were successful but when I tried to run the select query, it
failed giving me the the log attached)
> scala> cc.sql("select * from connectdemo1").show();

This message was sent by Atlassian JIRA

View raw message