pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lili Yu (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (PIG-5210) Option to print MR/Tez plan before launching
Date Thu, 06 Apr 2017 18:50:41 GMT

     [ https://issues.apache.org/jira/browse/PIG-5210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Lili Yu updated PIG-5210:
-------------------------
    Description: 
h5. Adding an option to print out MR/Tez plan before launching 

For pig script, users need to use {{pig -e "explain -script test.pig"}} to print out MR/Tez
Plan. But for Python script, it is a hard thing for PIG to explain the plan automatically.
This option can help to print out  MR/Tez plan automatically before implement of MapReduce.

Steps:
- Get clone of 0.17.0 version PIG by git pull
- Set up Eclipse 
- Import Pig src to Eclipse, and set pig.print.exec.plan "true" in file _JobControlCompiler.java_,_TezJobCompiler.java_
before Mapreduce starts
- Check for compiling {{ant}}
- After building successful, Start remote debugger in Eclipse {{export PIG_OPTS="- agentlib:jdwp=transport=dt_socket,server=y,suspend=y,address=8000"}}
Or start to run pig only in terminal {{unset PIG_OPTS}} 
- Test cases: For MR  engine {{-x local test.pig}}; For Tez engine {{-x tez_local test.pig}}
- Get the plan and test results as expected









  was:
Adding an option to print out MR/Tez plan before launching. 
- Without this option, users can use `pig -e "explain -script 1.pig"`



> Option to print MR/Tez plan before launching
> --------------------------------------------
>
>                 Key: PIG-5210
>                 URL: https://issues.apache.org/jira/browse/PIG-5210
>             Project: Pig
>          Issue Type: Improvement
>    Affects Versions: 0.17.0
>            Reporter: Lili Yu
>            Assignee: Lili Yu
>             Fix For: 0.17.0
>
>         Attachments: PrintPlan.patch, screenshot-change.png, screenshot MR plan.png,
screenshot Tez Plan.png, test.pig
>
>
> h5. Adding an option to print out MR/Tez plan before launching 
> For pig script, users need to use {{pig -e "explain -script test.pig"}} to print out
MR/Tez Plan. But for Python script, it is a hard thing for PIG to explain the plan automatically.
This option can help to print out  MR/Tez plan automatically before implement of MapReduce.
> Steps:
> - Get clone of 0.17.0 version PIG by git pull
> - Set up Eclipse 
> - Import Pig src to Eclipse, and set pig.print.exec.plan "true" in file _JobControlCompiler.java_,_TezJobCompiler.java_
before Mapreduce starts
> - Check for compiling {{ant}}
> - After building successful, Start remote debugger in Eclipse {{export PIG_OPTS="- agentlib:jdwp=transport=dt_socket,server=y,suspend=y,address=8000"}}
Or start to run pig only in terminal {{unset PIG_OPTS}} 
> - Test cases: For MR  engine {{-x local test.pig}}; For Tez engine {{-x tez_local test.pig}}
> - Get the plan and test results as expected



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message