spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Milad Bourhani (JIRA)" <>
Subject [jira] [Commented] (SPARK-3947) Support Scala/Java UDAF
Date Mon, 23 Nov 2015 12:54:11 GMT


Milad Bourhani commented on SPARK-3947:

Just for completeness, I'm attaching the [^]. For the record, it looks as if the first
time you run the clustered computation (right after you started {{./sbin/}}),
the computation is OK, even though the race condition error shows up in the log. After that,
it fails. So the attached logs contain exactly two executions: the first gives a correct answer,
the second doesn't.
To reproduce, run these commands on the unzipped project [^]:
mvn clean install
java -jar `ls target/uber*.jar` `ls target/uber*.jar` spark://master_host:7077
java -jar `ls target/uber*.jar` `ls target/uber*.jar` spark://master_host:7077
where {{spark://master_host:7077}} is your master URL.

> Support Scala/Java UDAF
> -----------------------
>                 Key: SPARK-3947
>                 URL:
>             Project: Spark
>          Issue Type: Sub-task
>          Components: SQL
>            Reporter: Pei-Lun Lee
>            Assignee: Yin Huai
>             Fix For: 1.5.0
>         Attachments:,,
> Right now only Hive UDAFs are supported. It would be nice to have UDAF similar to UDF
through SQLContext.registerFunction.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message