carbondata-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ravindra Pesala (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (CARBONDATA-836) Error in load using dataframe - columns containing comma
Date Wed, 10 May 2017 07:18:04 GMT

     [ https://issues.apache.org/jira/browse/CARBONDATA-836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Ravindra Pesala updated CARBONDATA-836:
---------------------------------------
    Fix Version/s:     (was: NONE)
                   1.1.1

> Error in load using dataframe  - columns containing comma
> ---------------------------------------------------------
>
>                 Key: CARBONDATA-836
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-836
>             Project: CarbonData
>          Issue Type: Bug
>          Components: spark-integration
>    Affects Versions: 1.1.0
>         Environment: HDP sandbox 2.5, Spark 1.6.2
>            Reporter: Sanoj MG
>            Assignee: Sanoj MG
>            Priority: Minor
>             Fix For: 1.1.1
>
>
> While trying to load data into Carabondata table using dataframe, the columns containing
commas are not properly loaded. 
> Eg: 
> scala> df.show(false)
> +-------+------+-----------+----------------+---------+------+
> |Country|Branch|Name       |Address         |ShortName|Status|
> +-------+------+-----------+----------------+---------+------+
> |2      |1     |Main Branch|XXXX, Dubai, UAE|UHO      |256   |
> +-------+------+-----------+----------------+---------+------+
> scala>  df.write.format("carbondata").option("tableName", "Branch1").option("compress",
"true").mode(SaveMode.Overwrite).save()
> scala> cc.sql("select * from branch1").show(false)
> +-------+------+-----------+-------+---------+------+
> |country|branch|name       |address|shortname|status|
> +-------+------+-----------+-------+---------+------+
> |2      |1     |Main Branch|XXXX   | Dubai   |null  |
> +-------+------+-----------+-------+---------+------+



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message