hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jimmy Xiang" <>
Subject Re: Review Request 33251: HIVE-10302 Cache small tables in memory [Spark Branch]
Date Thu, 23 Apr 2015 23:22:33 GMT

This is an automatically generated e-mail. To reply, visit:

(Updated April 23, 2015, 11:22 p.m.)

Review request for hive, Chao Sun, Szehon Ho, and Xuefu Zhang.

Bugs: HIVE-10302

Repository: hive-git


Cached the small table containter so that mapjoin tasks can use it if the task is executed
on the same Spark executor.
The cache is released right before the next job after the mapjoin job is done.

Diffs (updated)

  ql/src/java/org/apache/hadoop/hive/ql/exec/spark/ fe108c4 
  ql/src/java/org/apache/hadoop/hive/ql/exec/spark/ 2f137f9 
  ql/src/java/org/apache/hadoop/hive/ql/exec/spark/ PRE-CREATION 
  ql/src/java/org/apache/hadoop/hive/ql/exec/spark/ 72ab913 



Ran several queries in live cluster. ptest pending.


Jimmy Xiang

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message