hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sergio Pena <>
Subject Re: Review Request 48233: HIVE-13884: Disallow queries fetching more than a configured number of partitions in PartitionPruner
Date Fri, 17 Jun 2016 15:18:45 GMT

This is an automatically generated e-mail. To reply, visit:

(Updated June 17, 2016, 3:18 p.m.)

Review request for hive, Mohit Sabharwal and Naveen Gangam.


Address changes mentioned by Mohit and Szehon.

Bugs: HIVE-13884

Repository: hive-git


The patch verifies the # of partitions a table has before fetching any from the metastore.
t checks that limit from 'hive.limit.query.max.table.partition'.

A limitation added here is that the variable must be on hive-site.xml in order to work, and
it does not accept to set this through beeline because does not read the
variables set through beeline. I think it is better to keep it this way to avoid users changing
the value on fly, and crashing the metastore.

Another change is that EXPLAIN commands won't be executed either. EXPLAIN commands need to
fetch partitions in order to create the operator tree. If we allow EXPLAIN to do that, then
we may have the same OOM situations for large partitions.

Diffs (updated)

  common/src/java/org/apache/hadoop/hive/conf/ cc950089cf52a0344e1be0c42309d521fb8cb4d6

  metastore/src/java/org/apache/hadoop/hive/metastore/ c0827ea9d47e569d9697649a7e16d196de3de14d

  metastore/src/java/org/apache/hadoop/hive/metastore/ c135179b97354108f842a5ca2de0c6f0ef28b7fc

  metastore/src/java/org/apache/hadoop/hive/metastore/ da188d33d6194740ba9ecb37a6e533ecf1ec6906

  metastore/src/java/org/apache/hadoop/hive/metastore/ a6d3f5385b33b8a4e31ee20ca5cb8f58c97c8702

  metastore/src/java/org/apache/hadoop/hive/metastore/hbase/ 31f0d7b89670b8a749bbe8a7ff2b4ff9f059a8e2

  metastore/src/test/org/apache/hadoop/hive/metastore/ 3152e77c3c7152ac4dbe7e779ce35f28044fe3c9

  metastore/src/test/org/apache/hadoop/hive/metastore/ 86a243609b23e2ca9bb8849f0da863a95e477d5c



Waiting for HiveQA.


Sergio Pena

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message