Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 5EC6E200BB7 for ; Tue, 4 Oct 2016 19:32:50 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 5D77A160AF0; Tue, 4 Oct 2016 17:32:50 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 7B851160B00 for ; Tue, 4 Oct 2016 19:32:47 +0200 (CEST) Received: (qmail 76406 invoked by uid 500); 4 Oct 2016 17:32:46 -0000 Mailing-List: contact commits-help@spark.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list commits@spark.apache.org Received: (qmail 75538 invoked by uid 99); 4 Oct 2016 17:32:46 -0000 Received: from git1-us-west.apache.org (HELO git1-us-west.apache.org) (140.211.11.23) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 04 Oct 2016 17:32:46 +0000 Received: by git1-us-west.apache.org (ASF Mail Server at git1-us-west.apache.org, from userid 33) id EED3CE108E; Tue, 4 Oct 2016 17:32:45 +0000 (UTC) Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit From: rxin@apache.org To: commits@spark.apache.org Date: Tue, 04 Oct 2016 17:33:07 -0000 Message-Id: <4b254d6c8a6e45268fda4efce26509e3@git.apache.org> In-Reply-To: <5d47eae5bac6491eb122ccc7d7f8edff@git.apache.org> References: <5d47eae5bac6491eb122ccc7d7f8edff@git.apache.org> X-Mailer: ASF-Git Admin Mailer Subject: [23/51] [partial] spark-website git commit: Add doc for 2.0.1 archived-at: Tue, 04 Oct 2016 17:32:50 -0000 http://git-wip-us.apache.org/repos/asf/spark-website/blob/7c7b45c8/site/docs/2.0.1/api/R/write.jdbc.html ---------------------------------------------------------------------- diff --git a/site/docs/2.0.1/api/R/write.jdbc.html b/site/docs/2.0.1/api/R/write.jdbc.html new file mode 100644 index 0000000..94dcbfb --- /dev/null +++ b/site/docs/2.0.1/api/R/write.jdbc.html @@ -0,0 +1,299 @@ + +R: Save the content of SparkDataFrame to an external database... + + + + + + + + + +
write.jdbc {SparkR}R Documentation
+ +

Save the content of SparkDataFrame to an external database table via JDBC.

+ +

Description

+ +

Save the content of the SparkDataFrame to an external database table via JDBC. Additional JDBC +database connection properties can be set (...) +

+ + +

Usage

+ +
+## S4 method for signature 'SparkDataFrame,character,character'
+write.jdbc(x, url, tableName,
+  mode = "error", ...)
+
+write.jdbc(x, url, tableName, mode = "error", ...)
+
+ + +

Arguments

+ + + + + + + + + + + + +
x +

a SparkDataFrame.

+
url +

JDBC database url of the form jdbc:subprotocol:subname.

+
tableName +

yhe name of the table in the external database.

+
mode +

one of 'append', 'overwrite', 'error', 'ignore' save mode (it is 'error' by default).

+
... +

additional JDBC database connection properties.

+
+ + +

Details

+ +

Also, mode is used to specify the behavior of the save operation when +data already exists in the data source. There are four modes: +

+ +
    +
  • append: Contents of this SparkDataFrame are expected to be appended to existing data. +

    +
  • +
  • overwrite: Existing data is expected to be overwritten by the contents of this +SparkDataFrame. +

    +
  • +
  • error: An exception is expected to be thrown. +

    +
  • +
  • ignore: The save operation is expected to not save the contents of the SparkDataFrame +and to not change the existing data. +

    +
+ + + +

Note

+ +

write.jdbc since 2.0.0 +

+ + +

See Also

+ +

Other SparkDataFrame functions: $, +$,SparkDataFrame-method, $<-, +$<-,SparkDataFrame-method, +select, select, +select,SparkDataFrame,Column-method, +select,SparkDataFrame,character-method, +select,SparkDataFrame,list-method; +SparkDataFrame-class; [, +[,SparkDataFrame-method, [[, +[[,SparkDataFrame,numericOrcharacter-method, +subset, subset, +subset,SparkDataFrame-method; +agg, agg, agg, +agg,GroupedData-method, +agg,SparkDataFrame-method, +summarize, summarize, +summarize, +summarize,GroupedData-method, +summarize,SparkDataFrame-method; +arrange, arrange, +arrange, +arrange,SparkDataFrame,Column-method, +arrange,SparkDataFrame,character-method, +orderBy,SparkDataFrame,characterOrColumn-method; +as.data.frame, +as.data.frame,SparkDataFrame-method; +attach, +attach,SparkDataFrame-method; +cache, cache, +cache,SparkDataFrame-method; +collect, collect, +collect,SparkDataFrame-method; +colnames, colnames, +colnames,SparkDataFrame-method, +colnames<-, colnames<-, +colnames<-,SparkDataFrame-method, +columns, columns, +columns,SparkDataFrame-method, +names, +names,SparkDataFrame-method, +names<-, +names<-,SparkDataFrame-method; +coltypes, coltypes, +coltypes,SparkDataFrame-method, +coltypes<-, coltypes<-, +coltypes<-,SparkDataFrame,character-method; +count,SparkDataFrame-method, +nrow, nrow, +nrow,SparkDataFrame-method; +createOrReplaceTempView, +createOrReplaceTempView, +createOrReplaceTempView,SparkDataFrame,character-method; +dapplyCollect, dapplyCollect, +dapplyCollect,SparkDataFrame,function-method; +dapply, dapply, +dapply,SparkDataFrame,function,structType-method; +describe, describe, +describe, +describe,SparkDataFrame,ANY-method, +describe,SparkDataFrame,character-method, +describe,SparkDataFrame-method, +summary, summary, +summary,SparkDataFrame-method; +dim, +dim,SparkDataFrame-method; +distinct, distinct, +distinct,SparkDataFrame-method, +unique, +unique,SparkDataFrame-method; +dropDuplicates, +dropDuplicates, +dropDuplicates,SparkDataFrame-method; +dropna, dropna, +dropna,SparkDataFrame-method, +fillna, fillna, +fillna,SparkDataFrame-method, +na.omit, na.omit, +na.omit,SparkDataFrame-method; +drop, drop, +drop, drop,ANY-method, +drop,SparkDataFrame-method; +dtypes, dtypes, +dtypes,SparkDataFrame-method; +except, except, +except,SparkDataFrame,SparkDataFrame-method; +explain, explain, +explain,SparkDataFrame-method; +filter, filter, +filter,SparkDataFrame,characterOrColumn-method, +where, where, +where,SparkDataFrame,characterOrColumn-method; +first, first, +first, +first,SparkDataFrame-method, +first,characterOrColumn-method; +gapplyCollect, gapplyCollect, +gapplyCollect, +gapplyCollect,GroupedData-method, +gapplyCollect,SparkDataFrame-method; +gapply, gapply, +gapply, +gapply,GroupedData-method, +gapply,SparkDataFrame-method; +groupBy, groupBy, +groupBy,SparkDataFrame-method, +group_by, group_by, +group_by,SparkDataFrame-method; +head, +head,SparkDataFrame-method; +histogram, +histogram,SparkDataFrame,characterOrColumn-method; +insertInto, insertInto, +insertInto,SparkDataFrame,character-method; +intersect, intersect, +intersect,SparkDataFrame,SparkDataFrame-method; +isLocal, isLocal, +isLocal,SparkDataFrame-method; +join, +join,SparkDataFrame,SparkDataFrame-method; +limit, limit, +limit,SparkDataFrame,numeric-method; +merge, merge, +merge,SparkDataFrame,SparkDataFrame-method; +mutate, mutate, +mutate,SparkDataFrame-method, +transform, transform, +transform,SparkDataFrame-method; +ncol, +ncol,SparkDataFrame-method; +persist, persist, +persist,SparkDataFrame,character-method; +printSchema, printSchema, +printSchema,SparkDataFrame-method; +randomSplit, randomSplit, +randomSplit,SparkDataFrame,numeric-method; +rbind, rbind, +rbind,SparkDataFrame-method; +registerTempTable, +registerTempTable, +registerTempTable,SparkDataFrame,character-method; +rename, rename, +rename,SparkDataFrame-method, +withColumnRenamed, +withColumnRenamed, +withColumnRenamed,SparkDataFrame,character,character-method; +repartition, repartition, +repartition,SparkDataFrame-method; +sample, sample, +sample,SparkDataFrame,logical,numeric-method, +sample_frac, sample_frac, +sample_frac,SparkDataFrame,logical,numeric-method; +saveAsParquetFile, +saveAsParquetFile, +saveAsParquetFile,SparkDataFrame,character-method, +write.parquet, write.parquet, +write.parquet,SparkDataFrame,character-method; +saveAsTable, saveAsTable, +saveAsTable,SparkDataFrame,character-method; +saveDF, saveDF, +saveDF,SparkDataFrame,character-method, +write.df, write.df, +write.df, +write.df,SparkDataFrame,character-method; +schema, schema, +schema,SparkDataFrame-method; +selectExpr, selectExpr, +selectExpr,SparkDataFrame,character-method; +showDF, showDF, +showDF,SparkDataFrame-method; +show, show, +show,Column-method, +show,GroupedData-method, +show,SparkDataFrame-method, +show,WindowSpec-method; str, +str,SparkDataFrame-method; +take, take, +take,SparkDataFrame,numeric-method; +union, union, +union,SparkDataFrame,SparkDataFrame-method, +unionAll, unionAll, +unionAll,SparkDataFrame,SparkDataFrame-method; +unpersist, unpersist, +unpersist,SparkDataFrame-method; +withColumn, withColumn, +withColumn,SparkDataFrame,character,Column-method; +with, +with,SparkDataFrame-method; +write.json, write.json, +write.json,SparkDataFrame,character-method; +write.orc, write.orc, +write.orc,SparkDataFrame,character-method; +write.text, write.text, +write.text,SparkDataFrame,character-method +

+ + +

Examples

+ +
## Not run: 
+##D sparkR.session()
+##D jdbcUrl <- "jdbc:mysql://localhost:3306/databasename"
+##D write.jdbc(df, jdbcUrl, "table", user = "username", password = "password")
+## End(Not run)
+
+ + +
[Package SparkR version 2.0.1 Index]
+ http://git-wip-us.apache.org/repos/asf/spark-website/blob/7c7b45c8/site/docs/2.0.1/api/R/write.json.html ---------------------------------------------------------------------- diff --git a/site/docs/2.0.1/api/R/write.json.html b/site/docs/2.0.1/api/R/write.json.html new file mode 100644 index 0000000..0144a5f --- /dev/null +++ b/site/docs/2.0.1/api/R/write.json.html @@ -0,0 +1,263 @@ + +R: Save the contents of SparkDataFrame as a JSON file + + + + + + + + + +
write.json {SparkR}R Documentation
+ +

Save the contents of SparkDataFrame as a JSON file

+ +

Description

+ +

Save the contents of a SparkDataFrame as a JSON file (one object per line). Files written out +with this method can be read back in as a SparkDataFrame using read.json(). +

+ + +

Usage

+ +
+## S4 method for signature 'SparkDataFrame,character'
+write.json(x, path)
+
+write.json(x, path)
+
+ + +

Arguments

+ + + + + + +
x +

A SparkDataFrame

+
path +

The directory where the file is saved

+
+ + +

Note

+ +

write.json since 1.6.0 +

+ + +

See Also

+ +

Other SparkDataFrame functions: $, +$,SparkDataFrame-method, $<-, +$<-,SparkDataFrame-method, +select, select, +select,SparkDataFrame,Column-method, +select,SparkDataFrame,character-method, +select,SparkDataFrame,list-method; +SparkDataFrame-class; [, +[,SparkDataFrame-method, [[, +[[,SparkDataFrame,numericOrcharacter-method, +subset, subset, +subset,SparkDataFrame-method; +agg, agg, agg, +agg,GroupedData-method, +agg,SparkDataFrame-method, +summarize, summarize, +summarize, +summarize,GroupedData-method, +summarize,SparkDataFrame-method; +arrange, arrange, +arrange, +arrange,SparkDataFrame,Column-method, +arrange,SparkDataFrame,character-method, +orderBy,SparkDataFrame,characterOrColumn-method; +as.data.frame, +as.data.frame,SparkDataFrame-method; +attach, +attach,SparkDataFrame-method; +cache, cache, +cache,SparkDataFrame-method; +collect, collect, +collect,SparkDataFrame-method; +colnames, colnames, +colnames,SparkDataFrame-method, +colnames<-, colnames<-, +colnames<-,SparkDataFrame-method, +columns, columns, +columns,SparkDataFrame-method, +names, +names,SparkDataFrame-method, +names<-, +names<-,SparkDataFrame-method; +coltypes, coltypes, +coltypes,SparkDataFrame-method, +coltypes<-, coltypes<-, +coltypes<-,SparkDataFrame,character-method; +count,SparkDataFrame-method, +nrow, nrow, +nrow,SparkDataFrame-method; +createOrReplaceTempView, +createOrReplaceTempView, +createOrReplaceTempView,SparkDataFrame,character-method; +dapplyCollect, dapplyCollect, +dapplyCollect,SparkDataFrame,function-method; +dapply, dapply, +dapply,SparkDataFrame,function,structType-method; +describe, describe, +describe, +describe,SparkDataFrame,ANY-method, +describe,SparkDataFrame,character-method, +describe,SparkDataFrame-method, +summary, summary, +summary,SparkDataFrame-method; +dim, +dim,SparkDataFrame-method; +distinct, distinct, +distinct,SparkDataFrame-method, +unique, +unique,SparkDataFrame-method; +dropDuplicates, +dropDuplicates, +dropDuplicates,SparkDataFrame-method; +dropna, dropna, +dropna,SparkDataFrame-method, +fillna, fillna, +fillna,SparkDataFrame-method, +na.omit, na.omit, +na.omit,SparkDataFrame-method; +drop, drop, +drop, drop,ANY-method, +drop,SparkDataFrame-method; +dtypes, dtypes, +dtypes,SparkDataFrame-method; +except, except, +except,SparkDataFrame,SparkDataFrame-method; +explain, explain, +explain,SparkDataFrame-method; +filter, filter, +filter,SparkDataFrame,characterOrColumn-method, +where, where, +where,SparkDataFrame,characterOrColumn-method; +first, first, +first, +first,SparkDataFrame-method, +first,characterOrColumn-method; +gapplyCollect, gapplyCollect, +gapplyCollect, +gapplyCollect,GroupedData-method, +gapplyCollect,SparkDataFrame-method; +gapply, gapply, +gapply, +gapply,GroupedData-method, +gapply,SparkDataFrame-method; +groupBy, groupBy, +groupBy,SparkDataFrame-method, +group_by, group_by, +group_by,SparkDataFrame-method; +head, +head,SparkDataFrame-method; +histogram, +histogram,SparkDataFrame,characterOrColumn-method; +insertInto, insertInto, +insertInto,SparkDataFrame,character-method; +intersect, intersect, +intersect,SparkDataFrame,SparkDataFrame-method; +isLocal, isLocal, +isLocal,SparkDataFrame-method; +join, +join,SparkDataFrame,SparkDataFrame-method; +limit, limit, +limit,SparkDataFrame,numeric-method; +merge, merge, +merge,SparkDataFrame,SparkDataFrame-method; +mutate, mutate, +mutate,SparkDataFrame-method, +transform, transform, +transform,SparkDataFrame-method; +ncol, +ncol,SparkDataFrame-method; +persist, persist, +persist,SparkDataFrame,character-method; +printSchema, printSchema, +printSchema,SparkDataFrame-method; +randomSplit, randomSplit, +randomSplit,SparkDataFrame,numeric-method; +rbind, rbind, +rbind,SparkDataFrame-method; +registerTempTable, +registerTempTable, +registerTempTable,SparkDataFrame,character-method; +rename, rename, +rename,SparkDataFrame-method, +withColumnRenamed, +withColumnRenamed, +withColumnRenamed,SparkDataFrame,character,character-method; +repartition, repartition, +repartition,SparkDataFrame-method; +sample, sample, +sample,SparkDataFrame,logical,numeric-method, +sample_frac, sample_frac, +sample_frac,SparkDataFrame,logical,numeric-method; +saveAsParquetFile, +saveAsParquetFile, +saveAsParquetFile,SparkDataFrame,character-method, +write.parquet, write.parquet, +write.parquet,SparkDataFrame,character-method; +saveAsTable, saveAsTable, +saveAsTable,SparkDataFrame,character-method; +saveDF, saveDF, +saveDF,SparkDataFrame,character-method, +write.df, write.df, +write.df, +write.df,SparkDataFrame,character-method; +schema, schema, +schema,SparkDataFrame-method; +selectExpr, selectExpr, +selectExpr,SparkDataFrame,character-method; +showDF, showDF, +showDF,SparkDataFrame-method; +show, show, +show,Column-method, +show,GroupedData-method, +show,SparkDataFrame-method, +show,WindowSpec-method; str, +str,SparkDataFrame-method; +take, take, +take,SparkDataFrame,numeric-method; +union, union, +union,SparkDataFrame,SparkDataFrame-method, +unionAll, unionAll, +unionAll,SparkDataFrame,SparkDataFrame-method; +unpersist, unpersist, +unpersist,SparkDataFrame-method; +withColumn, withColumn, +withColumn,SparkDataFrame,character,Column-method; +with, +with,SparkDataFrame-method; +write.jdbc, write.jdbc, +write.jdbc,SparkDataFrame,character,character-method; +write.orc, write.orc, +write.orc,SparkDataFrame,character-method; +write.text, write.text, +write.text,SparkDataFrame,character-method +

+ + +

Examples

+ +
## Not run: 
+##D sparkR.session()
+##D path <- "path/to/file.json"
+##D df <- read.json(path)
+##D write.json(df, "/tmp/sparkr-tmp/")
+## End(Not run)
+
+ + +
[Package SparkR version 2.0.1 Index]
+ http://git-wip-us.apache.org/repos/asf/spark-website/blob/7c7b45c8/site/docs/2.0.1/api/R/write.ml.html ---------------------------------------------------------------------- diff --git a/site/docs/2.0.1/api/R/write.ml.html b/site/docs/2.0.1/api/R/write.ml.html new file mode 100644 index 0000000..238c1bb --- /dev/null +++ b/site/docs/2.0.1/api/R/write.ml.html @@ -0,0 +1,53 @@ + +R: Saves the MLlib model to the input path + + + + +
write.ml {SparkR}R Documentation
+ +

Saves the MLlib model to the input path

+ +

Description

+ +

Saves the MLlib model to the input path. For more information, see the specific +MLlib model below. +

+ + +

Usage

+ +
+write.ml(object, path, ...)
+
+ + +

Arguments

+ + + + + + + + +
object +

a fitted ML model object.

+
path +

the directory where the model is saved.

+
... +

additional argument(s) passed to the method.

+
+ + +

See Also

+ +

spark.glm, glm +

+

spark.kmeans, spark.naiveBayes, spark.survreg +

+

read.ml +

+ +
[Package SparkR version 2.0.1 Index]
+ http://git-wip-us.apache.org/repos/asf/spark-website/blob/7c7b45c8/site/docs/2.0.1/api/R/write.orc.html ---------------------------------------------------------------------- diff --git a/site/docs/2.0.1/api/R/write.orc.html b/site/docs/2.0.1/api/R/write.orc.html new file mode 100644 index 0000000..a00dce5 --- /dev/null +++ b/site/docs/2.0.1/api/R/write.orc.html @@ -0,0 +1,263 @@ + +R: Save the contents of SparkDataFrame as an ORC file,... + + + + + + + + + +
write.orc {SparkR}R Documentation
+ +

Save the contents of SparkDataFrame as an ORC file, preserving the schema.

+ +

Description

+ +

Save the contents of a SparkDataFrame as an ORC file, preserving the schema. Files written out +with this method can be read back in as a SparkDataFrame using read.orc(). +

+ + +

Usage

+ +
+## S4 method for signature 'SparkDataFrame,character'
+write.orc(x, path)
+
+write.orc(x, path)
+
+ + +

Arguments

+ + + + + + +
x +

A SparkDataFrame

+
path +

The directory where the file is saved

+
+ + +

Note

+ +

write.orc since 2.0.0 +

+ + +

See Also

+ +

Other SparkDataFrame functions: $, +$,SparkDataFrame-method, $<-, +$<-,SparkDataFrame-method, +select, select, +select,SparkDataFrame,Column-method, +select,SparkDataFrame,character-method, +select,SparkDataFrame,list-method; +SparkDataFrame-class; [, +[,SparkDataFrame-method, [[, +[[,SparkDataFrame,numericOrcharacter-method, +subset, subset, +subset,SparkDataFrame-method; +agg, agg, agg, +agg,GroupedData-method, +agg,SparkDataFrame-method, +summarize, summarize, +summarize, +summarize,GroupedData-method, +summarize,SparkDataFrame-method; +arrange, arrange, +arrange, +arrange,SparkDataFrame,Column-method, +arrange,SparkDataFrame,character-method, +orderBy,SparkDataFrame,characterOrColumn-method; +as.data.frame, +as.data.frame,SparkDataFrame-method; +attach, +attach,SparkDataFrame-method; +cache, cache, +cache,SparkDataFrame-method; +collect, collect, +collect,SparkDataFrame-method; +colnames, colnames, +colnames,SparkDataFrame-method, +colnames<-, colnames<-, +colnames<-,SparkDataFrame-method, +columns, columns, +columns,SparkDataFrame-method, +names, +names,SparkDataFrame-method, +names<-, +names<-,SparkDataFrame-method; +coltypes, coltypes, +coltypes,SparkDataFrame-method, +coltypes<-, coltypes<-, +coltypes<-,SparkDataFrame,character-method; +count,SparkDataFrame-method, +nrow, nrow, +nrow,SparkDataFrame-method; +createOrReplaceTempView, +createOrReplaceTempView, +createOrReplaceTempView,SparkDataFrame,character-method; +dapplyCollect, dapplyCollect, +dapplyCollect,SparkDataFrame,function-method; +dapply, dapply, +dapply,SparkDataFrame,function,structType-method; +describe, describe, +describe, +describe,SparkDataFrame,ANY-method, +describe,SparkDataFrame,character-method, +describe,SparkDataFrame-method, +summary, summary, +summary,SparkDataFrame-method; +dim, +dim,SparkDataFrame-method; +distinct, distinct, +distinct,SparkDataFrame-method, +unique, +unique,SparkDataFrame-method; +dropDuplicates, +dropDuplicates, +dropDuplicates,SparkDataFrame-method; +dropna, dropna, +dropna,SparkDataFrame-method, +fillna, fillna, +fillna,SparkDataFrame-method, +na.omit, na.omit, +na.omit,SparkDataFrame-method; +drop, drop, +drop, drop,ANY-method, +drop,SparkDataFrame-method; +dtypes, dtypes, +dtypes,SparkDataFrame-method; +except, except, +except,SparkDataFrame,SparkDataFrame-method; +explain, explain, +explain,SparkDataFrame-method; +filter, filter, +filter,SparkDataFrame,characterOrColumn-method, +where, where, +where,SparkDataFrame,characterOrColumn-method; +first, first, +first, +first,SparkDataFrame-method, +first,characterOrColumn-method; +gapplyCollect, gapplyCollect, +gapplyCollect, +gapplyCollect,GroupedData-method, +gapplyCollect,SparkDataFrame-method; +gapply, gapply, +gapply, +gapply,GroupedData-method, +gapply,SparkDataFrame-method; +groupBy, groupBy, +groupBy,SparkDataFrame-method, +group_by, group_by, +group_by,SparkDataFrame-method; +head, +head,SparkDataFrame-method; +histogram, +histogram,SparkDataFrame,characterOrColumn-method; +insertInto, insertInto, +insertInto,SparkDataFrame,character-method; +intersect, intersect, +intersect,SparkDataFrame,SparkDataFrame-method; +isLocal, isLocal, +isLocal,SparkDataFrame-method; +join, +join,SparkDataFrame,SparkDataFrame-method; +limit, limit, +limit,SparkDataFrame,numeric-method; +merge, merge, +merge,SparkDataFrame,SparkDataFrame-method; +mutate, mutate, +mutate,SparkDataFrame-method, +transform, transform, +transform,SparkDataFrame-method; +ncol, +ncol,SparkDataFrame-method; +persist, persist, +persist,SparkDataFrame,character-method; +printSchema, printSchema, +printSchema,SparkDataFrame-method; +randomSplit, randomSplit, +randomSplit,SparkDataFrame,numeric-method; +rbind, rbind, +rbind,SparkDataFrame-method; +registerTempTable, +registerTempTable, +registerTempTable,SparkDataFrame,character-method; +rename, rename, +rename,SparkDataFrame-method, +withColumnRenamed, +withColumnRenamed, +withColumnRenamed,SparkDataFrame,character,character-method; +repartition, repartition, +repartition,SparkDataFrame-method; +sample, sample, +sample,SparkDataFrame,logical,numeric-method, +sample_frac, sample_frac, +sample_frac,SparkDataFrame,logical,numeric-method; +saveAsParquetFile, +saveAsParquetFile, +saveAsParquetFile,SparkDataFrame,character-method, +write.parquet, write.parquet, +write.parquet,SparkDataFrame,character-method; +saveAsTable, saveAsTable, +saveAsTable,SparkDataFrame,character-method; +saveDF, saveDF, +saveDF,SparkDataFrame,character-method, +write.df, write.df, +write.df, +write.df,SparkDataFrame,character-method; +schema, schema, +schema,SparkDataFrame-method; +selectExpr, selectExpr, +selectExpr,SparkDataFrame,character-method; +showDF, showDF, +showDF,SparkDataFrame-method; +show, show, +show,Column-method, +show,GroupedData-method, +show,SparkDataFrame-method, +show,WindowSpec-method; str, +str,SparkDataFrame-method; +take, take, +take,SparkDataFrame,numeric-method; +union, union, +union,SparkDataFrame,SparkDataFrame-method, +unionAll, unionAll, +unionAll,SparkDataFrame,SparkDataFrame-method; +unpersist, unpersist, +unpersist,SparkDataFrame-method; +withColumn, withColumn, +withColumn,SparkDataFrame,character,Column-method; +with, +with,SparkDataFrame-method; +write.jdbc, write.jdbc, +write.jdbc,SparkDataFrame,character,character-method; +write.json, write.json, +write.json,SparkDataFrame,character-method; +write.text, write.text, +write.text,SparkDataFrame,character-method +

+ + +

Examples

+ +
## Not run: 
+##D sparkR.session()
+##D path <- "path/to/file.json"
+##D df <- read.json(path)
+##D write.orc(df, "/tmp/sparkr-tmp1/")
+## End(Not run)
+
+ + +
[Package SparkR version 2.0.1 Index]
+ http://git-wip-us.apache.org/repos/asf/spark-website/blob/7c7b45c8/site/docs/2.0.1/api/R/write.parquet.html ---------------------------------------------------------------------- diff --git a/site/docs/2.0.1/api/R/write.parquet.html b/site/docs/2.0.1/api/R/write.parquet.html new file mode 100644 index 0000000..942c26a --- /dev/null +++ b/site/docs/2.0.1/api/R/write.parquet.html @@ -0,0 +1,268 @@ + +R: Save the contents of SparkDataFrame as a Parquet file,... + + + + + + + + + +
write.parquet {SparkR}R Documentation
+ +

Save the contents of SparkDataFrame as a Parquet file, preserving the schema.

+ +

Description

+ +

Save the contents of a SparkDataFrame as a Parquet file, preserving the schema. Files written out +with this method can be read back in as a SparkDataFrame using read.parquet(). +

+ + +

Usage

+ +
+## S4 method for signature 'SparkDataFrame,character'
+write.parquet(x, path)
+
+## S4 method for signature 'SparkDataFrame,character'
+saveAsParquetFile(x, path)
+
+write.parquet(x, path)
+
+saveAsParquetFile(x, path)
+
+ + +

Arguments

+ + + + + + +
x +

A SparkDataFrame

+
path +

The directory where the file is saved

+
+ + +

Note

+ +

write.parquet since 1.6.0 +

+

saveAsParquetFile since 1.4.0 +

+ + +

See Also

+ +

Other SparkDataFrame functions: $, +$,SparkDataFrame-method, $<-, +$<-,SparkDataFrame-method, +select, select, +select,SparkDataFrame,Column-method, +select,SparkDataFrame,character-method, +select,SparkDataFrame,list-method; +SparkDataFrame-class; [, +[,SparkDataFrame-method, [[, +[[,SparkDataFrame,numericOrcharacter-method, +subset, subset, +subset,SparkDataFrame-method; +agg, agg, agg, +agg,GroupedData-method, +agg,SparkDataFrame-method, +summarize, summarize, +summarize, +summarize,GroupedData-method, +summarize,SparkDataFrame-method; +arrange, arrange, +arrange, +arrange,SparkDataFrame,Column-method, +arrange,SparkDataFrame,character-method, +orderBy,SparkDataFrame,characterOrColumn-method; +as.data.frame, +as.data.frame,SparkDataFrame-method; +attach, +attach,SparkDataFrame-method; +cache, cache, +cache,SparkDataFrame-method; +collect, collect, +collect,SparkDataFrame-method; +colnames, colnames, +colnames,SparkDataFrame-method, +colnames<-, colnames<-, +colnames<-,SparkDataFrame-method, +columns, columns, +columns,SparkDataFrame-method, +names, +names,SparkDataFrame-method, +names<-, +names<-,SparkDataFrame-method; +coltypes, coltypes, +coltypes,SparkDataFrame-method, +coltypes<-, coltypes<-, +coltypes<-,SparkDataFrame,character-method; +count,SparkDataFrame-method, +nrow, nrow, +nrow,SparkDataFrame-method; +createOrReplaceTempView, +createOrReplaceTempView, +createOrReplaceTempView,SparkDataFrame,character-method; +dapplyCollect, dapplyCollect, +dapplyCollect,SparkDataFrame,function-method; +dapply, dapply, +dapply,SparkDataFrame,function,structType-method; +describe, describe, +describe, +describe,SparkDataFrame,ANY-method, +describe,SparkDataFrame,character-method, +describe,SparkDataFrame-method, +summary, summary, +summary,SparkDataFrame-method; +dim, +dim,SparkDataFrame-method; +distinct, distinct, +distinct,SparkDataFrame-method, +unique, +unique,SparkDataFrame-method; +dropDuplicates, +dropDuplicates, +dropDuplicates,SparkDataFrame-method; +dropna, dropna, +dropna,SparkDataFrame-method, +fillna, fillna, +fillna,SparkDataFrame-method, +na.omit, na.omit, +na.omit,SparkDataFrame-method; +drop, drop, +drop, drop,ANY-method, +drop,SparkDataFrame-method; +dtypes, dtypes, +dtypes,SparkDataFrame-method; +except, except, +except,SparkDataFrame,SparkDataFrame-method; +explain, explain, +explain,SparkDataFrame-method; +filter, filter, +filter,SparkDataFrame,characterOrColumn-method, +where, where, +where,SparkDataFrame,characterOrColumn-method; +first, first, +first, +first,SparkDataFrame-method, +first,characterOrColumn-method; +gapplyCollect, gapplyCollect, +gapplyCollect, +gapplyCollect,GroupedData-method, +gapplyCollect,SparkDataFrame-method; +gapply, gapply, +gapply, +gapply,GroupedData-method, +gapply,SparkDataFrame-method; +groupBy, groupBy, +groupBy,SparkDataFrame-method, +group_by, group_by, +group_by,SparkDataFrame-method; +head, +head,SparkDataFrame-method; +histogram, +histogram,SparkDataFrame,characterOrColumn-method; +insertInto, insertInto, +insertInto,SparkDataFrame,character-method; +intersect, intersect, +intersect,SparkDataFrame,SparkDataFrame-method; +isLocal, isLocal, +isLocal,SparkDataFrame-method; +join, +join,SparkDataFrame,SparkDataFrame-method; +limit, limit, +limit,SparkDataFrame,numeric-method; +merge, merge, +merge,SparkDataFrame,SparkDataFrame-method; +mutate, mutate, +mutate,SparkDataFrame-method, +transform, transform, +transform,SparkDataFrame-method; +ncol, +ncol,SparkDataFrame-method; +persist, persist, +persist,SparkDataFrame,character-method; +printSchema, printSchema, +printSchema,SparkDataFrame-method; +randomSplit, randomSplit, +randomSplit,SparkDataFrame,numeric-method; +rbind, rbind, +rbind,SparkDataFrame-method; +registerTempTable, +registerTempTable, +registerTempTable,SparkDataFrame,character-method; +rename, rename, +rename,SparkDataFrame-method, +withColumnRenamed, +withColumnRenamed, +withColumnRenamed,SparkDataFrame,character,character-method; +repartition, repartition, +repartition,SparkDataFrame-method; +sample, sample, +sample,SparkDataFrame,logical,numeric-method, +sample_frac, sample_frac, +sample_frac,SparkDataFrame,logical,numeric-method; +saveAsTable, saveAsTable, +saveAsTable,SparkDataFrame,character-method; +saveDF, saveDF, +saveDF,SparkDataFrame,character-method, +write.df, write.df, +write.df, +write.df,SparkDataFrame,character-method; +schema, schema, +schema,SparkDataFrame-method; +selectExpr, selectExpr, +selectExpr,SparkDataFrame,character-method; +showDF, showDF, +showDF,SparkDataFrame-method; +show, show, +show,Column-method, +show,GroupedData-method, +show,SparkDataFrame-method, +show,WindowSpec-method; str, +str,SparkDataFrame-method; +take, take, +take,SparkDataFrame,numeric-method; +union, union, +union,SparkDataFrame,SparkDataFrame-method, +unionAll, unionAll, +unionAll,SparkDataFrame,SparkDataFrame-method; +unpersist, unpersist, +unpersist,SparkDataFrame-method; +withColumn, withColumn, +withColumn,SparkDataFrame,character,Column-method; +with, +with,SparkDataFrame-method; +write.jdbc, write.jdbc, +write.jdbc,SparkDataFrame,character,character-method; +write.json, write.json, +write.json,SparkDataFrame,character-method; +write.orc, write.orc, +write.orc,SparkDataFrame,character-method; +write.text, write.text, +write.text,SparkDataFrame,character-method +

+ + +

Examples

+ +
## Not run: 
+##D sparkR.session()
+##D path <- "path/to/file.json"
+##D df <- read.json(path)
+##D write.parquet(df, "/tmp/sparkr-tmp1/")
+##D saveAsParquetFile(df, "/tmp/sparkr-tmp2/")
+## End(Not run)
+
+ + +
[Package SparkR version 2.0.1 Index]
+ --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org For additional commands, e-mail: commits-help@spark.apache.org