carbondata-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sanoj MG (JIRA)" <j...@apache.org>
Subject [jira] [Created] (CARBONDATA-909) Single pass option in dataframe writer
Date Wed, 12 Apr 2017 05:25:41 GMT
Sanoj MG created CARBONDATA-909:
-----------------------------------

             Summary: Single pass option in dataframe writer
                 Key: CARBONDATA-909
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-909
             Project: CarbonData
          Issue Type: Bug
          Components: spark-integration
    Affects Versions: 1.2.0-incubating, 1.1.1-incubating
         Environment: HDP 2.5 / Spark 1.6
            Reporter: Sanoj MG
            Assignee: Sanoj MG
            Priority: Minor
             Fix For: 1.2.0-incubating, 1.1.1-incubating


While creating a Carbondata table from dataframe, currently it is not possible to specify
single pass load in Spark 1.6. An option is required to specify it as below :

df.write.format("carbondata")
.option("tableName", "test")
.option("compress","true")
.option("single_pass","true")
.mode(SaveMode.Overwrite)
.save()



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message