hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From murali parimi <muralikrishna.par...@icloud.com>
Subject Re: Bucket map join - reducers role
Date Thu, 05 Mar 2015 14:53:14 GMT
> Hello team,
> 
> I have two tables A and B. A has 360Million rows with one column K. B has around two
billion rows with multiple columns including K.
> 
> Both tables are clustered and sorted by K and Bucketed into same number of buckets.
> 
> When I perform a join, I assumed there won't be any reducers spawned as the join would
happen on map side. But reducers getting spawned. 
> 
> Any role for reducers here? Am I missing something?

Sent from my iPhone

> On Feb 27, 2015, at 7:32 AM, murali parimi <muralikrishna.parimi@icloud.com> wrote:
> 
> Hello team,
> 
> I have two tables A and B. A has 360Million rows with one column K. B has around two
billion rows with multiple columns including K.
> 
> Both tables are clustered and sorted by K and Bucketed into same number of buckets.
> 
> When I perform a join, I assumed there won't be any reducers spawned as the join would
happen on map side. But reducers getting spawned. 
> 
> Any role for reducers here? Am I missing something?
> 
> Sent from my iPhone

Mime
View raw message