Mailing-List: contact issues-help@spark.apache.org; run by ezmlm
Precedence: bulk
Date: Tue, 1 Dec 2015 00:37:10 +0000 (UTC)
From: "Felix Cheung (JIRA)" <jira@apache.org>
To: issues@spark.apache.org
Message-ID: <JIRA.12914950.1448046908000.226599.1448930230938@Atlassian.JIRA>
In-Reply-To: <JIRA.12914950.1448046908000@Atlassian.JIRA>
References: <JIRA.12914950.1448046908000@Atlassian.JIRA>
 <JIRA.12914950.1448046908953@arcas>
Subject: [jira] [Commented] (SPARK-11886) R function name conflicts with
 base or stats package ones
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable


    [ https://issues.apache.org/jira/browse/SPARK-11886?page=3Dcom.atlassia=
n.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=3D150=
32810#comment-15032810 ]=20

Felix Cheung commented on SPARK-11886:
--------------------------------------

I see this if I load dplyr after SparkR

{code}
> library(dplyr)

Attaching package: =E2=80=98dplyr=E2=80=99

The following objects are masked from =E2=80=98package:SparkR=E2=80=99:

    arrange, between, collect, count, cume_dist, dense_rank, desc,
    distinct, explain, filter, first, group_by, intersect, lag, last,
    lead, mutate, n, n_distinct, ntile, percent_rank, rename,
    row_number, sample_frac, select, sql, summarize

The following objects are masked from =E2=80=98package:stats=E2=80=99:

    filter, lag

The following objects are masked from =E2=80=98package:base=E2=80=99:

    intersect, setdiff, setequal, union

> select(a, row_number(a$Sepal_Length))
Error in UseMethod("select_") :
  no applicable method for 'select_' applied to an object of class "DataFra=
me"
> select(a, a$Sepal_Length)
Error in UseMethod("select_") :
  no applicable method for 'select_' applied to an object of class "DataFra=
me"
> select(a, "*")
Error in UseMethod("select_") :
  no applicable method for 'select_' applied to an object of class "DataFra=
me"
> r <- row_number(a$Sepal_Length)
Error in x[!nas] : object of type 'S4' is not subsettable
In addition: Warning message:
In is.na(x) : is.na() applied to non-(list or vector) of type 'S4'
> r <- dense_rank(a$Sepal_Length)
Error in x[!nas] : object of type 'S4' is not subsettable
In addition: Warning message:
In is.na(x) : is.na() applied to non-(list or vector) of type 'S4'
> collect(df)
Error in UseMethod("collect") :
  no applicable method for 'collect' applied to an object of class "DataFra=
me"
{code}

Seems like a bunch of things are broken

> R function name conflicts with base or stats package ones
> ---------------------------------------------------------
>
>                 Key: SPARK-11886
>                 URL: https://issues.apache.org/jira/browse/SPARK-11886
>             Project: Spark
>          Issue Type: Bug
>          Components: SparkR
>    Affects Versions: 1.5.2
>            Reporter: Felix Cheung
>            Priority: Minor
>
> See https://github.com/apache/spark/pull/9785
> Currently these are masked:
> stats::cov
> stats::filter
> base::sample
> base::table
> [~shivaram] suggested:
> "
> If we have same name but the param types completely don't match (and no r=
oom for ...) then we override those functions but (This is true for sample,=
 table, cov right now I guess) we should try to limit the number of functio=
ns where we do this. Also we should revisit some of these to see if we can =
avoid it (for example table can be renamed ?)
> "


--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org