pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jonathan Coveney (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (PIG-2927) SHIP and use JRuby gems in JRuby UDFs
Date Wed, 03 Oct 2012 00:43:08 GMT

     [ https://issues.apache.org/jira/browse/PIG-2927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Jonathan Coveney updated PIG-2927:

    Attachment: PIG-2927-0.patch

I just attached a patch that adds gem support. Any script registered as so:

register script.rb using jruby as myfuncs;

will be instantiated locally, and the set of dependencies across scripts will be shipped.


- JRUBY_HOME must be set on the client side. This is so we know where to find the gems!
- you need to make sure to have a "require 'pigudf'" since it is instantiated on the client
side (I could probably fix this, but I think forcing this is desirable for testing of scripts


Any chance you can try this out and see if it works?

I'll add tests sometime...
> SHIP and use JRuby gems in JRuby UDFs
> -------------------------------------
>                 Key: PIG-2927
>                 URL: https://issues.apache.org/jira/browse/PIG-2927
>             Project: Pig
>          Issue Type: New Feature
>          Components: parser
>    Affects Versions: 0.11
>         Environment: JRuby UDFs
>            Reporter: Russell Jurney
>            Assignee: Jonathan Coveney
>            Priority: Minor
>         Attachments: PIG-2927-0.patch
> It would be great to use JRuby gems in JRuby UDFs without installing them on all machines
on the cluster. Some way to SHIP them automatically with the job would be great.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message