Mailing-List: contact user-help@hive.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hive.apache.org
Received-SPF: pass (athena.apache.org: domain of ajo.fod@gmail.com designates
 74.125.82.176 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:date:message-id:subject:from:to:content-type;
        b=si5cfCiLLeGDLLqWP+4a4tge0RFvKlsF31go3uWzIK+nVAswSBK6cnH2tlp4eEWtAH
         E4+BNkZBzAzBs5GOK04tlgWqzNr8YW5z4e6Z2ixRdDIrbZySW53DYPJtHb9T0IKNeRub
         Gxu1+O3cdsQHLO9tfvrp/gARwbDjO8AX1G+MU=
MIME-Version: 1.0
Date: Wed, 19 Jan 2011 07:46:20 -0800
Message-ID: <AANLkTikRAA2kPiHze=fcqXKh3Yp+zDdxZGrVkUrhj+9Z@mail.gmail.com>
Subject: how do I use multiple reducers in hive?
From: Ajo Fod <ajo.fod@gmail.com>
To: user@hive.apache.org
Content-Type: text/plain; charset=ISO-8859-1

I've 2 questions:
1) how to raise the number of reducers?
2) why are there only 2 bucket files per partition even though I
specified 32 buckets?


I've set the following and don't see an increase in the number of reducers.
>>set hive.exec.reducers.max=32;
>>set mapred.reduce.tasks=32;

Could this be because the jobs are too small?

I have a feeling that this is the cause for my having only 2 bucket
files in each partition, inspite of specifing 32 buckets.

-Ajo.