hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Phabricator (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-2561) Add an annotation to UDFs to allow them to specify additional FILE/JAR resources necessary for execution
Date Mon, 21 Nov 2011 21:12:54 GMT

    [ https://issues.apache.org/jira/browse/HIVE-2561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13154520#comment-13154520
] 

Phabricator commented on HIVE-2561:
-----------------------------------

jsichi has commented on the revision "HIVE-2561 [jira] Add an annotation to UDFs to allow
them to specify additional FILE/JAR resources necessary for execution".

INLINE COMMENTS
  ql/src/java/org/apache/hadoop/hive/ql/exec/FunctionRegistry.java:1091 Why?  I don't understand
the connection between statefulness and external jar dependency.
  ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFInFile.java:41 Have you tested
this on a real cluster to make sure the paths actually come out the same on both the client
side and inside the task execution?

REVISION DETAIL
  https://reviews.facebook.net/D507

                
> Add an annotation to UDFs to allow them to specify additional FILE/JAR resources necessary
for execution
> --------------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-2561
>                 URL: https://issues.apache.org/jira/browse/HIVE-2561
>             Project: Hive
>          Issue Type: New Feature
>            Reporter: Jonathan Chang
>            Assignee: Jonathan Chang
>         Attachments: HIVE-2561.D507.1.patch
>
>
> Often times UDFs will have dependencies to external JARs/FILEs.  It makes sense for these
to be encoded by the UDF (rather than having the caller remember the set of files that need
to be ADDed).  Let's add an annotation to UDFs which will cause these resources to be auto-added.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message