spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chakravarthi (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-27543) Support getRequiredJars and getRequiredFiles APIs for Hive UDFs
Date Thu, 02 May 2019 04:27:00 GMT

    [ https://issues.apache.org/jira/browse/SPARK-27543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16831407#comment-16831407
] 

Chakravarthi commented on SPARK-27543:
--------------------------------------

[~makagonov]  SparkContext.addJar could be used to include the required additional resources
.

> Support getRequiredJars and getRequiredFiles APIs for Hive UDFs
> ---------------------------------------------------------------
>
>                 Key: SPARK-27543
>                 URL: https://issues.apache.org/jira/browse/SPARK-27543
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>    Affects Versions: 2.0.0, 2.4.1
>            Reporter: Sergey
>            Priority: Minor
>   Original Estimate: 1,344h
>  Remaining Estimate: 1,344h
>
> *getRequiredJars* and *getRequiredFiles* - functions to automatically include additional
resources required by a UDF. The files that are provided in methods would be accessible by
executors by simple file name. This is necessary for UDFs that need to have some required
files distributed, or classes from third-party jars to be available from executors. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message