spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xiao Li (JIRA)" <>
Subject [jira] [Created] (SPARK-23400) Add two extra constructors for ScalaUDF
Date Mon, 12 Feb 2018 22:18:00 GMT
Xiao Li created SPARK-23400:

             Summary: Add two extra constructors for ScalaUDF
                 Key: SPARK-23400
             Project: Spark
          Issue Type: Bug
          Components: SQL
    Affects Versions: 2.2.1, 2.1.2, 2.3.0
            Reporter: Xiao Li
            Assignee: Xiao Li

The last few releases, we changed the interface of ScalaUDF. Unfortunately, some Spark Package
(spark-deep-learning) are using our internal class `ScalaUDF`. In the release 2.2 and 2.3,
we added new parameters into these class. The users hit the binary compatibility issues and
got the exception:

> java.lang.NoSuchMethodError: org.apache.spark.sql.catalyst.expressions.ScalaUDF.&lt;init&gt;(Ljava/lang/Object;Lorg/apache/spark/sql/types/DataType;Lscala/collection/Seq;Lscala/collection/Seq;Lscala/Option;)V

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message