hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alan Gates (JIRA)" <j...@apache.org>
Subject [jira] Commented: (PIG-928) UDFs in scripting languages
Date Sat, 17 Oct 2009 00:55:31 GMT

    [ https://issues.apache.org/jira/browse/PIG-928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12766806#action_12766806
] 

Alan Gates commented on PIG-928:
--------------------------------

A couple thoughts:

1) I still have to figure out how to do type translation in BSF.  The current patch just assumes
one string argument and then does reflection on the fly on return to figure out what it is
returning.  We may or may not be able to expose schemas to scripted UDFs (ala outputSchema
and argToFuncMapping) but we at least need to handle multiple and non-string arguments.  I
need to do more digging in order to understand how to do this type translation in BSF.

2) For at least some either jython or jruby we've got to show better than a 30x differential.
 There are some products you're just too embarrassed to sell.  We may be able to speed this
up some by having the framework figure out the return type for this UDF and always convert
the returning object based on that return type rather than trying to do reflection.

I don't know ruby or python, and I don't have time at the moment to go learn either.  If someone
is willing to give me snippets of python and/or ruby that mimic the split functionality given
in the patch, I'm happy to test against those two in BSF and see what happens.

> UDFs in scripting languages
> ---------------------------
>
>                 Key: PIG-928
>                 URL: https://issues.apache.org/jira/browse/PIG-928
>             Project: Pig
>          Issue Type: New Feature
>            Reporter: Alan Gates
>         Attachments: package.zip
>
>
> It should be possible to write UDFs in scripting languages such as python, ruby, etc.
 This frees users from needing to compile Java, generate a jar, etc.  It also opens Pig to
programmers who prefer scripting languages over Java.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message