carbondata-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sanoj MG (JIRA)" <j...@apache.org>
Subject [jira] [Created] (CARBONDATA-836) Error in load using dataframe - columns containing comma
Date Thu, 30 Mar 2017 08:14:41 GMT
Sanoj MG created CARBONDATA-836:
-----------------------------------

             Summary: Error in load using dataframe  - columns containing comma
                 Key: CARBONDATA-836
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-836
             Project: CarbonData
          Issue Type: Bug
          Components: spark-integration
    Affects Versions: 1.1.0-incubating
         Environment: HDP sandbox 2.5, Spark 1.6.2
            Reporter: Sanoj MG
            Priority: Minor
             Fix For: NONE


While trying to load data into Carabondata table using dataframe, the columns containing commas
are not properly loaded. 

Eg: 
scala> df.show(false)
+-------+------+-----------+----------------+---------+------+
|Country|Branch|Name       |Address         |ShortName|Status|
+-------+------+-----------+----------------+---------+------+
|2      |1     |Main Branch|XXXX, Dubai, UAE|UHO      |256   |
+-------+------+-----------+----------------+---------+------+


scala>  df.write.format("carbondata").option("tableName", "Branch1").option("compress",
"true").mode(SaveMode.Overwrite).save()


scala> cc.sql("select * from branch1").show(false)

+-------+------+-----------+-------+---------+------+
|country|branch|name       |address|shortname|status|
+-------+------+-----------+-------+---------+------+
|2      |1     |Main Branch|XXXX   | Dubai   |null  |
+-------+------+-----------+-------+---------+------+






--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message