hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Gopal Vijayaraghavan <gop...@apache.org>
Subject Re: Two Tables Join (One Big table and other 1gb size table)
Date Tue, 13 Oct 2015 19:42:12 GMT

> I tried doing stream table, but ran for long time like 3 hrs : Looks
>like only 1 reducer is working on it
...
> on (trim(p.pid)=trim(c.p_id) and p.source='XYZ');

In case that's devolving to a cross-product, it might be a miss in pushing
down the trim() to the TableScan.

Are you using hive-13? If you're using a version >1.0.0, can you see if
the query prints a warning about cross-products?

Cheers,
Gopal



Mime
View raw message