hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Deepak Jaiswal <djais...@hortonworks.com>
Subject Review Request 57903: HIVE-16282 Add faststart for semijoin reducer
Date Fri, 24 Mar 2017 02:33:01 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/57903/
-----------------------------------------------------------

Review request for hive, Gopal V, Jason Dere, and Siddharth Seth.


Bugs: HIVE-16282
    https://issues.apache.org/jira/browse/HIVE-16282


Repository: hive-git


Description
-------

Currently all reducers have slow start meaning, the mappers get preference in scheduling.
However, incase of semijoin reductions, the reducer of semijoin branch should get priority
before the mapper to which it feeds in.


Diffs
-----

  ql/src/java/org/apache/hadoop/hive/ql/exec/tez/DagUtils.java aa2dfc7 
  ql/src/java/org/apache/hadoop/hive/ql/optimizer/DynamicPartitionPruningOptimization.java
727f7bc 
  ql/src/java/org/apache/hadoop/hive/ql/parse/GenTezUtils.java 905431f 
  ql/src/java/org/apache/hadoop/hive/ql/parse/GenTezWork.java 97f3300 
  ql/src/java/org/apache/hadoop/hive/ql/plan/ReduceSinkDesc.java 38461d5 
  ql/src/java/org/apache/hadoop/hive/ql/plan/ReduceWork.java ee784dc 
  ql/src/java/org/apache/hadoop/hive/ql/plan/TezEdgeProperty.java a3aa12f 


Diff: https://reviews.apache.org/r/57903/diff/1/


Testing
-------


Thanks,

Deepak Jaiswal


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message