pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Cheolsoo Park" <piaozhe...@gmail.com>
Subject Review Request 14505: PIG-3501 Initial implementation of TezJobControlCompiler
Date Sat, 05 Oct 2013 00:28:41 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/14505/
-----------------------------------------------------------

Review request for pig, Daniel Dai, Mark Wagner, and Rohini Palaniswamy.


Bugs: PIG-3501
    https://issues.apache.org/jira/browse/PIG-3501


Repository: pig-git


Description
-------

Initial implementation of TezJonControlCompiler that converts tez plan into tez dag. Tez dag
is built by TezDagBuilder that is a dependency walker of TezOpPlan. At each node, it creates
a tez vertex and connect it to dependent vertices with a tez edge.


Diffs
-----

  src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/JobControlCompiler.java
8077776 
  src/org/apache/pig/backend/hadoop/executionengine/tez/DagUtils.java abd71ad 
  src/org/apache/pig/backend/hadoop/executionengine/tez/TezDagBuilder.java PRE-CREATION 
  src/org/apache/pig/backend/hadoop/executionengine/tez/TezJob.java f6a98d0 
  src/org/apache/pig/backend/hadoop/executionengine/tez/TezJobControlCompiler.java 213ef33

  src/org/apache/pig/impl/util/Utils.java b5cffcf 
  test/org/apache/pig/tez/TestTezJobControlCompiler.java PRE-CREATION 

Diff: https://reviews.apache.org/r/14505/diff/


Testing
-------

Added unit test cases to TestTezJobControlCompiler.


Thanks,

Cheolsoo Park


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message