hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Shubham Chopra (JIRA)" <j...@apache.org>
Subject [jira] Issue Comment Edited: (PIG-366) PigPen - Eclipse plugin for a graphical PigLatin editor
Date Thu, 13 Nov 2008 11:31:44 GMT

    [ https://issues.apache.org/jira/browse/PIG-366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12646834#action_12646834
] 

shubhamc edited comment on PIG-366 at 11/13/08 3:31 AM:
--------------------------------------------------------------

PigPen plugin jar containing the compiled plugin. I was not able to get a build.xml for the
plugin since it needs to be compiled in eclipse environment. 

Notes on using the plugin:
1. The plugin right now supports script editing from in the text form. You can switch to the
graphic view to see the alternate graph representation of the script.
2. You would have to supply a suitable hadoop-site.xml for the plugin to be able to connect
to a cluster. You can also submit the job using the plugin.
3. The plugin might not work in cases where the access to cluster is restricted/firewalled
and is only allowed through gateways.
4. You can copy a part of the data (The example generator uses 10,000 records) and copy that
to a local single-node pseudo-distributed cluster that can easily be setup (http://hadoop.apache.org/core/docs/r0.18.2/quickstart.html#PseudoDistributed).
You can then use the plugin with this pseudo-cluster to tweak the script and see the examples.

The plugin uses the example generator in PIG (http://wiki.apache.org/pig/ExampleGenerator).
An introduction to the plugin can be seen here
http://wiki.apache.org/pig/PigPen

      was (Author: shubhamc):
    PigPen plugin jar containing the compiled plugin. I was not able to get a build.xml for
the plugin since it needs to be compiled in eclipse environment. 

Notes on using the plugin:
1. The plugin right now supports script editing from in the text form. You can switch to the
graphic view to see the alternate graph representation of the script.
2. You would have to supply a suitable hadoop-site.xml for the plugin to be able to connect
to a cluster. You can also submit the job using the plugin.
3. The plugin might not work in cases where the access to cluster is restricted/firewalled
and is only allowed through gateways.
4. You can copy a part of the data (The example generator uses 10,000 records) and copy that
to a local single-node pseudo-distributed cluster that can easily be setup (http://hadoop.apache.org/core/docs/r0.18.2/quickstart.html#PseudoDistributed).
You can then use the plugin with this pseudo-cluster to tweak the script and see the examples.

The plugin uses the example generator in PIG (http://wiki.apache.org/pig/ExampleGenerator)
  
> PigPen - Eclipse plugin for a graphical PigLatin editor
> -------------------------------------------------------
>
>                 Key: PIG-366
>                 URL: https://issues.apache.org/jira/browse/PIG-366
>             Project: Pig
>          Issue Type: New Feature
>            Reporter: Shubham Chopra
>            Priority: Minor
>         Attachments: org.apache.pig.pigpen_0.0.1.jar, org.apache.pig.pigpen_0.0.1.tgz,
pigpen.patch, pigPen.patch
>
>
> This is an Eclipse plugin that provides a GUI that can help users create PigLatin scripts
and see the example generator outputs on the fly and submit the jobs to hadoop clusters.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message