hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chao Sun" <>
Subject Re: Review Request 28017: HIVE-8776 - Generate MapredLocalWork in SparkMapJoinResolver [Spark Brach]
Date Fri, 14 Nov 2014 02:43:17 GMT

This is an automatically generated e-mail. To reply, visit:

(Updated Nov. 14, 2014, 2:43 a.m.)

Review request for hive, Jimmy Xiang, Szehon Ho, and Xuefu Zhang.


Thanks Xuefu for the comments!

Bugs: HIVE-8776

Repository: hive-git


In SparkMapJoinResolver, we need to populate MapredLocalWork for all MapWorks with MapJoinOperator.
It is needed later in HashTableLoader, for example, to retrieve small hash tables and direct
fetch tables.
We need to set up information, such as aliasToWork, aliasToFetchWork, directFetchOp, inputFileChangeSensitive,
tmpPath, etc., for the new local works.

Diffs (updated)

  ql/src/java/org/apache/hadoop/hive/ql/exec/spark/ d30ae51 
  ql/src/java/org/apache/hadoop/hive/ql/optimizer/physical/ 9ce1a18

  ql/src/java/org/apache/hadoop/hive/ql/plan/ 785e4a0 




Chao Sun

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message