R: Computes the ceiling of the given value

Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 4B04E200CA3 for ; Wed, 3 May 2017 00:00:45 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 49A11160B9D; Tue, 2 May 2017 22:00:45 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id E4693160BE8 for ; Wed, 3 May 2017 00:00:40 +0200 (CEST) Received: (qmail 20872 invoked by uid 500); 2 May 2017 22:00:39 -0000 Mailing-List: contact commits-help@spark.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list commits@spark.apache.org Received: (qmail 18707 invoked by uid 99); 2 May 2017 22:00:38 -0000 Received: from git1-us-west.apache.org (HELO git1-us-west.apache.org) (140.211.11.23) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 02 May 2017 22:00:38 +0000 Received: by git1-us-west.apache.org (ASF Mail Server at git1-us-west.apache.org, from userid 33) id 49727DF9A3; Tue, 2 May 2017 22:00:38 +0000 (UTC) Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit From: marmbrus@apache.org To: commits@spark.apache.org Date: Tue, 02 May 2017 22:01:20 -0000 Message-Id: <0556456112ca4fe0a8da6eb8cf4eef9f@git.apache.org> In-Reply-To: <2812d736e01d48afbc308cebd5a36c0b@git.apache.org> References: <2812d736e01d48afbc308cebd5a36c0b@git.apache.org> X-Mailer: ASF-Git Admin Mailer Subject: [45/51] [partial] spark-website git commit: Add Spark 2.1.1 docs archived-at: Tue, 02 May 2017 22:00:45 -0000 http://git-wip-us.apache.org/repos/asf/spark-website/blob/d4f0c34a/site/docs/2.1.1/api/R/ceil.html ---------------------------------------------------------------------- diff --git a/site/docs/2.1.1/api/R/ceil.html b/site/docs/2.1.1/api/R/ceil.html new file mode 100644 index 0000000..745ae17 --- /dev/null +++ b/site/docs/2.1.1/api/R/ceil.html @@ -0,0 +1,126 @@ + +R: Computes the ceiling of the given value + + + + + + + + + +

ceil {SparkR}

R Documentation

+ +

Computes the ceiling of the given value

+ +

Description

+ +

Computes the ceiling of the given value. +

+ + +

Usage

+ +

+## S4 method for signature 'Column'
+ceil(x)
+
+## S4 method for signature 'Column'
+ceiling(x)
+
+ceil(x)
+

+ + +

Arguments

+ + + + +

`x`	+ Column to compute on. +

+ + +

Note

+ +

ceil since 1.5.0 +

ceiling since 1.5.0 +

+ + +

Examples

+ +

## Not run: ceil(df$c)
+## Not run: ceiling(df$c)
+

+ + +

[Package SparkR version 2.1.1 Index]

+ http://git-wip-us.apache.org/repos/asf/spark-website/blob/d4f0c34a/site/docs/2.1.1/api/R/clearCache.html ---------------------------------------------------------------------- diff --git a/site/docs/2.1.1/api/R/clearCache.html b/site/docs/2.1.1/api/R/clearCache.html new file mode 100644 index 0000000..be03890 --- /dev/null +++ b/site/docs/2.1.1/api/R/clearCache.html @@ -0,0 +1,45 @@ + +R: Clear Cache + + + + + + + + + +

clearCache {SparkR}

R Documentation

+ +

Clear Cache

+ +

Description

+ +

Removes all cached tables from the in-memory cache. +

+ + +

Usage

+ +

+## Default S3 method:
+clearCache()
+

+ + +

Note

+ +

clearCache since 1.4.0 +

+ + +

Examples

+ +

## Not run: 
+##D clearCache()
+## End(Not run)
+

+ + +

[Package SparkR version 2.1.1 Index]

+ http://git-wip-us.apache.org/repos/asf/spark-website/blob/d4f0c34a/site/docs/2.1.1/api/R/clearJobGroup.html ---------------------------------------------------------------------- diff --git a/site/docs/2.1.1/api/R/clearJobGroup.html b/site/docs/2.1.1/api/R/clearJobGroup.html new file mode 100644 index 0000000..c8ce1f5 --- /dev/null +++ b/site/docs/2.1.1/api/R/clearJobGroup.html @@ -0,0 +1,46 @@ + +R: Clear current job group ID and its description + + + + + + + + + +

clearJobGroup {SparkR}

R Documentation

+ +

Clear current job group ID and its description

+ +

Description

+ +

Clear current job group ID and its description +

+ + +

Usage

+ +

+## Default S3 method:
+clearJobGroup()
+

+ + +

Note

+ +

clearJobGroup since 1.5.0 +

+ + +

Examples

+ +

## Not run: 
+##D sparkR.session()
+##D clearJobGroup()
+## End(Not run)
+

+ + +

[Package SparkR version 2.1.1 Index]

+ http://git-wip-us.apache.org/repos/asf/spark-website/blob/d4f0c34a/site/docs/2.1.1/api/R/coalesce.html ---------------------------------------------------------------------- diff --git a/site/docs/2.1.1/api/R/coalesce.html b/site/docs/2.1.1/api/R/coalesce.html new file mode 100644 index 0000000..7354d10 --- /dev/null +++ b/site/docs/2.1.1/api/R/coalesce.html @@ -0,0 +1,336 @@ + +R: Coalesce + + + + + + + + + +

coalesce {SparkR}

R Documentation

+ +

Coalesce

+ +

Description

+ +

Returns a new SparkDataFrame that has exactly numPartitions partitions. +This operation results in a narrow dependency, e.g. if you go from 1000 partitions to 100 +partitions, there will not be a shuffle, instead each of the 100 new partitions will claim 10 of +the current partitions. If a larger number of partitions is requested, it will stay at the +current number of partitions. +

Returns the first column that is not NA, or NA if all inputs are. +

+ + +

Usage

+ +

+## S4 method for signature 'SparkDataFrame'
+coalesce(x, numPartitions)
+
+## S4 method for signature 'Column'
+coalesce(x, ...)
+
+coalesce(x, ...)
+

+ + +

Arguments

+ + + + + + + + +

`x`	+ a Column or a SparkDataFrame. +
`numPartitions`	+ the number of partitions to use. +
`...`	+ additional argument(s). If `x` is a Column, additional Columns can be optionally +provided. +

+ + +

Details

+ +

However, if you're doing a drastic coalesce on a SparkDataFrame, e.g. to numPartitions = 1, +this may result in your computation taking place on fewer nodes than +you like (e.g. one node in the case of numPartitions = 1). To avoid this, +call repartition. This will add a shuffle step, but means the +current upstream partitions will be executed in parallel (per whatever +the current partitioning is). +

+ + +

Note

+ +

coalesce(SparkDataFrame) since 2.1.1 +

coalesce(Column) since 2.1.1 +

+ + +

Other normal_funcs: Column-class, +column, column, +column, +column,character-method, +column,jobj-method; abs, +abs,Column-method; +bitwiseNOT, bitwiseNOT, +bitwiseNOT,Column-method; +expr, expr, +expr,character-method; +greatest, greatest, +greatest,Column-method; +ifelse, ifelse,Column-method; +is.nan, is.nan,Column-method, +isnan, isnan, +isnan,Column-method; least, +least, least,Column-method; +lit, lit, +lit,ANY-method; nanvl, +nanvl, nanvl,Column-method; +negate, negate, +negate,Column-method; randn, +randn, randn, +randn,missing-method, +randn,numeric-method; rand, +rand, rand, +rand,missing-method, +rand,numeric-method; struct, +struct, +struct,characterOrColumn-method; +when, when, +when,Column-method +

+ + +

Examples

+ +

## Not run: 
+##D sparkR.session()
+##D path <- "path/to/file.json"
+##D df <- read.json(path)
+##D newDF <- coalesce(df, 1L)
+## End(Not run)
+## Not run: coalesce(df$c, df$d, df$e)
+

+ + +

[Package SparkR version 2.1.1 Index]

+ http://git-wip-us.apache.org/repos/asf/spark-website/blob/d4f0c34a/site/docs/2.1.1/api/R/collect.html ---------------------------------------------------------------------- diff --git a/site/docs/2.1.1/api/R/collect.html b/site/docs/2.1.1/api/R/collect.html new file mode 100644 index 0000000..db24703 --- /dev/null +++ b/site/docs/2.1.1/api/R/collect.html @@ -0,0 +1,281 @@ + +R: Collects all the elements of a SparkDataFrame and coerces... + + + + + + + + + +

collect {SparkR}

R Documentation

+ +

Collects all the elements of a SparkDataFrame and coerces them into an R data.frame.

+ +

Description

+ +

Collects all the elements of a SparkDataFrame and coerces them into an R data.frame. +

+ + +

Usage

+ +

+## S4 method for signature 'SparkDataFrame'
+collect(x, stringsAsFactors = FALSE)
+
+collect(x, ...)
+

+ + +

Arguments

+ + + + + + + + +

`x`	+ a SparkDataFrame. +
`stringsAsFactors`	+ (Optional) a logical indicating whether or not string columns +should be converted to factors. FALSE by default. +
`...`	+ further arguments to be passed to or from other methods. +

+ + +

Note

+ +

collect since 1.4.0 +

+ + +

Examples

+ +

## Not run: 
+##D sparkR.session()
+##D path <- "path/to/file.json"
+##D df <- read.json(path)
+##D collected <- collect(df)
+##D firstName <- collected[[1]]$name
+## End(Not run)
+

+ + +

[Package SparkR version 2.1.1 Index]

+ http://git-wip-us.apache.org/repos/asf/spark-website/blob/d4f0c34a/site/docs/2.1.1/api/R/coltypes.html ---------------------------------------------------------------------- diff --git a/site/docs/2.1.1/api/R/coltypes.html b/site/docs/2.1.1/api/R/coltypes.html new file mode 100644 index 0000000..3eeb076 --- /dev/null +++ b/site/docs/2.1.1/api/R/coltypes.html @@ -0,0 +1,295 @@ + +R: coltypes + + + + + + + + + +

coltypes {SparkR}

R Documentation

+ +

coltypes

+ +

Description

+ +

Get column types of a SparkDataFrame +

Set the column types of a SparkDataFrame. +

+ + +

Usage

+ +

+## S4 method for signature 'SparkDataFrame'
+coltypes(x)
+
+## S4 replacement method for signature 'SparkDataFrame,character'
+coltypes(x) <- value
+
+coltypes(x)
+
+coltypes(x) <- value
+

+ + +

Arguments

+ + + + + + +

`x`	+ A SparkDataFrame +
`value`	+ A character vector with the target column types for the given +SparkDataFrame. Column types can be one of integer, numeric/double, character, logical, or NA +to keep that column as-is. +

+ + +

Value

+ +

value A character vector with the column types of the given SparkDataFrame +

+ + +

Note

+ +

coltypes since 1.6.0 +

coltypes<- since 1.6.0 +

+ + +

Examples

+ +

## Not run: 
+##D irisDF <- createDataFrame(iris)
+##D coltypes(irisDF) # get column types
+## End(Not run)
+## Not run: 
+##D sparkR.session()
+##D path <- "path/to/file.json"
+##D df <- read.json(path)
+##D coltypes(df) <- c("character", "integer") # set column types
+##D coltypes(df) <- c(NA, "numeric") # set column types
+## End(Not run)
+

+ + +

[Package SparkR version 2.1.1 Index]

+ http://git-wip-us.apache.org/repos/asf/spark-website/blob/d4f0c34a/site/docs/2.1.1/api/R/column.html ---------------------------------------------------------------------- diff --git a/site/docs/2.1.1/api/R/column.html b/site/docs/2.1.1/api/R/column.html new file mode 100644 index 0000000..d281921 --- /dev/null +++ b/site/docs/2.1.1/api/R/column.html @@ -0,0 +1,108 @@ + +R: S4 class that represents a SparkDataFrame column + + + + + + + + + +

Column-class {SparkR}

R Documentation

+ +

S4 class that represents a SparkDataFrame column

+ +

Description

+ +

The column class supports unary, binary operations on SparkDataFrame columns +

Returns a Column based on the given column name. +

+ + +

Usage

+ +

+## S4 method for signature 'jobj'
+column(x)
+
+## S4 method for signature 'character'
+column(x)
+
+column(x)
+

+ + +

Arguments

+ + + + +

`x`	+ Character column name. +

+ + +

Slots

+ + +

jc: reference to JVM SparkDataFrame column
+

+ + +

Note

+ +

Column since 1.4.0 +

column since 1.6.0 +

+ + +

Examples

+ +

## Not run: column("name")
+

+ + +

[Package SparkR version 2.1.1 Index]

+ http://git-wip-us.apache.org/repos/asf/spark-website/blob/d4f0c34a/site/docs/2.1.1/api/R/columnfunctions.html ---------------------------------------------------------------------- diff --git a/site/docs/2.1.1/api/R/columnfunctions.html b/site/docs/2.1.1/api/R/columnfunctions.html new file mode 100644 index 0000000..f286f42 --- /dev/null +++ b/site/docs/2.1.1/api/R/columnfunctions.html @@ -0,0 +1,56 @@ + +R: A set of operations working with SparkDataFrame columns + + + + +

columnfunctions {SparkR}

R Documentation

+ +

A set of operations working with SparkDataFrame columns

+ +

Description

+ +

A set of operations working with SparkDataFrame columns +

+ + +

Usage

+ +

+asc(x)
+
+contains(x, ...)
+
+desc(x)
+
+getField(x, ...)
+
+getItem(x, ...)
+
+isNaN(x)
+
+isNull(x)
+
+isNotNull(x)
+
+like(x, ...)
+
+rlike(x, ...)
+

+ + +

Arguments

+ + + + + + +

`x`	+ a Column object. +
`...`	+ additional argument(s). +

+ +

[Package SparkR version 2.1.1 Index]

+ --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org For additional commands, e-mail: commits-help@spark.apache.org

Computes the ceiling of the given value

Description

Usage

Arguments

Note

See Also

Examples

Clear Cache

Description

Usage

Note

Examples

Clear current job group ID and its description

Description

Usage

Note

Examples

Coalesce

Description

Usage

Arguments

Details

Note

See Also

Examples

Collects all the elements of a SparkDataFrame and coerces them into an R data.frame.

Description

Usage

Arguments

Note

See Also

Examples

coltypes

Description

Usage

Arguments

Value

Note

See Also

Examples

S4 class that represents a SparkDataFrame column

Description

Usage

Arguments

Slots

Note

See Also

Examples

A set of operations working with SparkDataFrame columns

Description

Usage

Arguments