hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ajo Fod <ajo....@gmail.com>
Subject how do I use multiple reducers in hive?
Date Wed, 19 Jan 2011 15:46:20 GMT
I've 2 questions:
1) how to raise the number of reducers?
2) why are there only 2 bucket files per partition even though I
specified 32 buckets?


I've set the following and don't see an increase in the number of reducers.
>>set hive.exec.reducers.max=32;
>>set mapred.reduce.tasks=32;

Could this be because the jobs are too small?

I have a feeling that this is the cause for my having only 2 bucket
files in each partition, inspite of specifing 32 buckets.

-Ajo.

Mime
View raw message