pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daniel Dai (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (PIG-5210) Option to print MR/Tez plan before launching
Date Thu, 06 Apr 2017 22:09:41 GMT

     [ https://issues.apache.org/jira/browse/PIG-5210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Daniel Dai updated PIG-5210:
----------------------------
    Description: 
For pig script, users need to use {{pig -e "explain -script test.pig"}} to print out MR/Tez
Plan. But for Python script, it is a hard thing for PIG to explain the plan automatically.
This option can help to print out  MR/Tez plan automatically before implement of MapReduce.







  was:
h5. Adding an option to print out MR/Tez plan before launching 

For pig script, users need to use {{pig -e "explain -script test.pig"}} to print out MR/Tez
Plan. But for Python script, it is a hard thing for PIG to explain the plan automatically.
This option can help to print out  MR/Tez plan automatically before implement of MapReduce.

Steps:
- Get clone of 0.17.0 version PIG by git pull
- Set up Eclipse 
- Import Pig src to Eclipse, and set pig.print.exec.plan "true" in file _JobControlCompiler.java_,_TezJobCompiler.java_
before Mapreduce starts
- Check for compiling {{ant}}
- After building successful, Start remote debugger in Eclipse {{export PIG_OPTS="- agentlib:jdwp=transport=dt_socket,server=y,suspend=y,address=8000"}}
Or start to run pig only in terminal {{unset PIG_OPTS}} 
- Test cases: For MR  engine {{-x local test.pig}}; For Tez engine {{-x tez_local test.pig}}
- Get the plan and test results as expected










> Option to print MR/Tez plan before launching
> --------------------------------------------
>
>                 Key: PIG-5210
>                 URL: https://issues.apache.org/jira/browse/PIG-5210
>             Project: Pig
>          Issue Type: Improvement
>    Affects Versions: 0.17.0
>            Reporter: Lili Yu
>            Assignee: Lili Yu
>             Fix For: 0.17.0
>
>         Attachments: PrintPlan.patch, screenshot-change.png, screenshot MR plan.png,
screenshot Tez Plan.png, test.pig
>
>
> For pig script, users need to use {{pig -e "explain -script test.pig"}} to print out
MR/Tez Plan. But for Python script, it is a hard thing for PIG to explain the plan automatically.
This option can help to print out  MR/Tez plan automatically before implement of MapReduce.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message