pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Shubham Chopra (JIRA)" <j...@apache.org>
Subject [jira] Commented: (PIG-572) A PigServer.registerScript() method, which lets a client programmatically register a Pig Script.
Date Thu, 01 Jan 2009 03:50:44 GMT

    [ https://issues.apache.org/jira/browse/PIG-572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12660178#action_12660178
] 

Shubham Chopra commented on PIG-572:
------------------------------------

1. One use case is when users have a share-able script that does some preprocessing on data
so users can then reuse it and build on it when using embedded pig. Its straight forward when
using grunt, but not so much when using embedded pig. I'll ask Chris to point out any other
use cases that he might have in mind.
2. This was for the example generator. I need a maping between logical operators and the generated
examples. For cases where the grids are behind firewalls and can only be accessed through
gateways, I need to run the example generator on the gateway and then serialize the maps to
disk to get them to local machines. This needs the logical plan to be serializable.

> A PigServer.registerScript() method, which lets a client programmatically register a
Pig Script.
> ------------------------------------------------------------------------------------------------
>
>                 Key: PIG-572
>                 URL: https://issues.apache.org/jira/browse/PIG-572
>             Project: Pig
>          Issue Type: New Feature
>    Affects Versions: types_branch
>            Reporter: Shubham Chopra
>            Priority: Minor
>             Fix For: types_branch
>
>         Attachments: registerScript.patch
>
>
> A PigServer.registerScript() method, which lets a client programmatically register a
Pig Script.
> For example, say theres a script my_script.pig with the following content:
> a = load '/data/my_data.txt';
> b = filter a by $0 > '0';
> The function lets you use something like the following:
> pigServer.registerScript("my_script.pig");
> pigServer.registerQuery("c = foreach b generate $2, $3;");
> pigServer.store("c");

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message