hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daniel,Wu" <hadoop...@163.com>
Subject multiple tables join with only one hug table.
Date Fri, 12 Aug 2011 02:01:52 GMT
if the retailer fact table is sale_fact with 10B rows, and join with 3 small tables: stores
(10K), products(10K), period (1K). What's the best join solution?

In oracle, it can first build hash for stores, and hash for products, and hash for stores.
Then probe using the fact table, if the row matched in stores, that row can go up further
to map with products by hashing check, if pass, then go up further to try to match period.
In this way, the sale_fact only needs to be scanned once which save lots of disk IO.  Is this
doable in hive, if doable, what hint need to use?

Mime
View raw message