spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hyukjin Kwon (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (SPARK-26454) While creating new UDF with JAR though UDF is created successfully, it throws IllegegalArgument Exception
Date Wed, 02 Jan 2019 11:55:00 GMT

    [ https://issues.apache.org/jira/browse/SPARK-26454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16731983#comment-16731983
] 

Hyukjin Kwon edited comment on SPARK-26454 at 1/2/19 11:54 AM:
---------------------------------------------------------------

Thing is, we shouldn't introduce behaviour change when we fix. This code path is shared by
multiple APIs. Maybe we could consider lowering log level from error to warning.


was (Author: hyukjin.kwon):
Thing is, we shouldn't introduce behaviour change when we fix. Maybe we could consider lowering
log level from error to warning.

> While creating new UDF with JAR though UDF is created successfully, it throws IllegegalArgument
Exception
> ---------------------------------------------------------------------------------------------------------
>
>                 Key: SPARK-26454
>                 URL: https://issues.apache.org/jira/browse/SPARK-26454
>             Project: Spark
>          Issue Type: Bug
>          Components: Spark Shell
>    Affects Versions: 2.3.2
>            Reporter: Udbhav Agrawal
>            Priority: Trivial
>         Attachments: create_exception.txt
>
>
> 【Test step】:
>  1.launch spark-shell
>  2. set role admin;
>  3. create new function
>        CREATE FUNCTION Func AS 'org.apache.hadoop.hive.ql.udf.generic.GenericUDFLastDayTest'
USING JAR 'hdfs:///tmp/super_udf/two_udfs.jar'
>  4. Do select on the function
>  sql("select Func('2018-03-09')").show()
>  5.Create new UDF with same JAR
>     sql("CREATE FUNCTION newFunc AS 'org.apache.hadoop.hive.ql.udf.generic.GenericUDFLastDayTest'
USING JAR 'hdfs:///tmp/super_udf/two_udfs.jar'")
> 6. Do select on the new function created.
> sql("select newFunc ('2018-03-09')").show()
> 【Output】:
> Function is getting created but illegal argument exception is thrown , select provides
result but with illegal argument exception.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message