hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Prabhakar Reddy <>
Subject Dynamic partition pruning
Date Wed, 19 Dec 2018 08:02:25 GMT

I have a table large_table with more than 50K partitions and when I run
below query it is running for ever.The other table small_table2 has only
five partitions and when ever I run below query it seems to be scanning all
partitions rather than scanning only five partitions which are there in
smaller table.

select * from large_table a  where a.dt in (select dt from small_table2)
limit 5;

Could you please confirm if this is the expected behavior or any way we can
tune this query to fetch results faster?

Prabhakar Reddy

View raw message