pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jonathan Coveney (Updated) (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (PIG-2317) Ruby/Jruby UDFs
Date Tue, 28 Feb 2012 19:31:47 GMT

     [ https://issues.apache.org/jira/browse/PIG-2317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Jonathan Coveney updated PIG-2317:
----------------------------------

    Attachment: PIG-2317-8.patch

Phew! Ok, the tests now run. There was quite a bit of bug fixing that went in, both in the
ruby library 'pigudf', as well as in the UDFs themselves (they are cleaned up a bit). I added
support for DataByteArrays, as well as support making it a lot easier to concatenate them
together and whatnot.

As far as things I'd like to do...
- I'd like to make a much more natural way to interact with Schema objects from the Ruby side.
Right now you can return a schema and stuff, but goooood luck actually trying to manipulate
the object :) (it's possibly but it'd be ugly) I imagine the jython scripting suffers from
this as well
- Need to fix the enumerator interface on the DataBag and BagIterator. This is pending some
help from the JRuby folk.
- In general, need to balance making the API's look like their Java counterparts, but with
the nice conveniences that JRuby can offer so that UDFs can be really concise and easy
- I'd like to get rid of the need for pigudf.rb and implement it all in Java. This is the
least priority, though, because the current implementation works, and it is absolutely idiomatic
in jruby to implement libraries in jruby, so the above is more important.

Thanks again for the tests, Alan. They were really key. It should pass them now. I'll ruminate
on other good ones to add.
                
> Ruby/Jruby UDFs
> ---------------
>
>                 Key: PIG-2317
>                 URL: https://issues.apache.org/jira/browse/PIG-2317
>             Project: Pig
>          Issue Type: New Feature
>            Reporter: Jacob Perkins
>            Assignee: Jacob Perkins
>            Priority: Minor
>         Attachments: PIG-2317-8.patch, PigUdf.rb, PigUdf.rb, jruby_scripting.patch, jruby_scripting_2_real.patch,
jruby_scripting_3.patch, jruby_scripting_4.patch, jruby_scripting_5.patch, jruby_scripting_6.patch,
jruby_scripting_7.patch, pigjruby.rb, pigjruby.rb, pigjruby.rb, pigudf.rb
>
>
> It should be possible to write UDFs in Ruby. These UDFs will be registered in the same
way as python and javascript UDFs.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message