hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mayuresh Kunjir <>
Subject Fwd: Map join optimization issue
Date Thu, 07 Feb 2013 19:39:06 GMT
Hello all,

I am trying to join two tables, the smaller being of size 4GB. When I set
hive.mapjoin.smalltable.filesize parameter above 500MB, Hive tries to
perform a local task to read the smaller file. This of-course fails since
the file size is greater and the backup common join is then run. What I do
not understand is why did Hive attempt a map join when small file size was
greater than the smalltable.filesize parameter.


View raw message