carbondata-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sanoj MG (JIRA)" <j...@apache.org>
Subject [jira] [Assigned] (CARBONDATA-836) Error in load using dataframe - columns containing comma
Date Sun, 09 Apr 2017 06:47:41 GMT

     [ https://issues.apache.org/jira/browse/CARBONDATA-836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Sanoj MG reassigned CARBONDATA-836:
-----------------------------------

    Assignee: Sanoj MG

> Error in load using dataframe  - columns containing comma
> ---------------------------------------------------------
>
>                 Key: CARBONDATA-836
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-836
>             Project: CarbonData
>          Issue Type: Bug
>          Components: spark-integration
>    Affects Versions: 1.1.0-incubating
>         Environment: HDP sandbox 2.5, Spark 1.6.2
>            Reporter: Sanoj MG
>            Assignee: Sanoj MG
>            Priority: Minor
>             Fix For: NONE
>
>
> While trying to load data into Carabondata table using dataframe, the columns containing
commas are not properly loaded. 
> Eg: 
> scala> df.show(false)
> +-------+------+-----------+----------------+---------+------+
> |Country|Branch|Name       |Address         |ShortName|Status|
> +-------+------+-----------+----------------+---------+------+
> |2      |1     |Main Branch|XXXX, Dubai, UAE|UHO      |256   |
> +-------+------+-----------+----------------+---------+------+
> scala>  df.write.format("carbondata").option("tableName", "Branch1").option("compress",
"true").mode(SaveMode.Overwrite).save()
> scala> cc.sql("select * from branch1").show(false)
> +-------+------+-----------+-------+---------+------+
> |country|branch|name       |address|shortname|status|
> +-------+------+-----------+-------+---------+------+
> |2      |1     |Main Branch|XXXX   | Dubai   |null  |
> +-------+------+-----------+-------+---------+------+



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message