Return-Path: 
 <issues-return-80470-apmail-spark-issues-archive=spark.apache.org@spark.apache.org>
X-Original-To: apmail-spark-issues-archive@minotaur.apache.org
Delivered-To: apmail-spark-issues-archive@minotaur.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id 647A51876D
	for <apmail-spark-issues-archive@minotaur.apache.org>;
 Fri, 20 Nov 2015 21:15:11 +0000 (UTC)
Received: (qmail 38897 invoked by uid 500); 20 Nov 2015 21:15:11 -0000
Delivered-To: apmail-spark-issues-archive@spark.apache.org
Received: (qmail 38869 invoked by uid 500); 20 Nov 2015 21:15:11 -0000
Mailing-List: contact issues-help@spark.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:issues-help@spark.apache.org>
List-Unsubscribe: <mailto:issues-unsubscribe@spark.apache.org>
List-Post: <mailto:issues@spark.apache.org>
List-Id: <issues.spark.apache.org>
Delivered-To: mailing list issues@spark.apache.org
Received: (qmail 38859 invoked by uid 99); 20 Nov 2015 21:15:11 -0000
Received: from arcas.apache.org (HELO arcas) (140.211.11.28)
    by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 20 Nov 2015 21:15:11 +0000
Received: from arcas.apache.org (localhost [127.0.0.1])
	by arcas (Postfix) with ESMTP id 011D42C0450
	for <issues@spark.apache.org>; Fri, 20 Nov 2015 21:15:11 +0000 (UTC)
Date: Fri, 20 Nov 2015 21:15:11 +0000 (UTC)
From: "Michael Armbrust (JIRA)" <jira@apache.org>
To: issues@spark.apache.org
Message-ID: <JIRA.12914992.1448053711000.141867.1448054111000@Atlassian.JIRA>
In-Reply-To: <JIRA.12914992.1448053711000@Atlassian.JIRA>
References: <JIRA.12914992.1448053711000@Atlassian.JIRA>
 <JIRA.12914992.1448053711344@arcas>
Subject: [jira] [Updated] (SPARK-11889) Type inference in REPL broken for
 GroupedDataset.agg
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394


     [ https://issues.apache.org/jira/browse/SPARK-11889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Michael Armbrust updated SPARK-11889:
-------------------------------------
    Component/s: SQL

> Type inference in REPL broken for GroupedDataset.agg
> ----------------------------------------------------
>
>                 Key: SPARK-11889
>                 URL: https://issues.apache.org/jira/browse/SPARK-11889
>             Project: Spark
>          Issue Type: Bug
>          Components: SQL
>            Reporter: Michael Armbrust
>            Assignee: Michael Armbrust
>            Priority: Critical
>
> This works in compiled code, but fails in the REPL.
> {code}
> /** An `Aggregator` that adds up any numeric type returned by the given function. */
> class SumOf[I, N : Numeric](f: I => N) extends Aggregator[I, N, N] with Serializable {
>   val numeric = implicitly[Numeric[N]]
>   override def zero: N = numeric.zero
>   override def reduce(b: N, a: I): N = numeric.plus(b, f(a))
>   override def merge(b1: N,b2: N): N = numeric.plus(b1, b2)
>   override def finish(reduction: N): N = reduction
> }
> def sum[I, N : Numeric : Encoder](f: I => N): TypedColumn[I, N] = new SumOf(f).toColumn
> val ds = Seq((1, 1, 2L), (1, 2, 3L), (1, 3, 4L), (2, 1, 5L)).toDS()
> ds.groupBy(_._1).agg(count("*"), sum(_._2), sum(_._3)).collect()
> {code}
> {code}
> <console>:38: error: missing parameter type for expanded function ((x$2) => x$2._2)
>               ds.groupBy(_._1).agg(sum(_._2), sum(_._3)).collect()
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org