Return-Path: X-Original-To: apmail-hive-user-archive@www.apache.org Delivered-To: apmail-hive-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id DC0AD105D0 for ; Wed, 9 Oct 2013 12:40:00 +0000 (UTC) Received: (qmail 60611 invoked by uid 500); 9 Oct 2013 12:39:57 -0000 Delivered-To: apmail-hive-user-archive@hive.apache.org Received: (qmail 60421 invoked by uid 500); 9 Oct 2013 12:39:56 -0000 Mailing-List: contact user-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hive.apache.org Delivered-To: mailing list user@hive.apache.org Received: (qmail 60405 invoked by uid 99); 9 Oct 2013 12:39:51 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 09 Oct 2013 12:39:51 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of rajesh.balamohan@gmail.com designates 209.85.128.51 as permitted sender) Received: from [209.85.128.51] (HELO mail-qe0-f51.google.com) (209.85.128.51) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 09 Oct 2013 12:39:47 +0000 Received: by mail-qe0-f51.google.com with SMTP id q19so502915qeb.38 for ; Wed, 09 Oct 2013 05:39:26 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=86BRQnMffUGSNYjrLwgl4c8I88+DPp4pcZjP1NfOBRg=; b=FZAD7BGD+RfQwJXnvXoaRZ/tbOQrJCBPVIi5ugi6onM24UBAeggznORyW8L/OSjGKC wgKtJyX3V2fcJIaUMsiQbBneKRZ8uDRM67GbmNbB2LyZm7SR0UeXnVGf6/qjKbc1z4vL ZmBEGPDJwNZHWsZNyguwi2Qqq8I+tz0XWlJLJC7yb8K+8Ry2qXZtcqmiIvL5Y86bALA5 grLbp8vEHFBZLiP73mEb0O+7+B0AXUy/yHDKgZngZJI5tCluUOACuoVAzmJfnEtgtE76 qQvD+1XWUkU8PW4YVJdMpyfbcPK1KnbVuqWiCZ1J2KFrEbsI+2ElxyzeForbH+oO1nNF Zliw== MIME-Version: 1.0 X-Received: by 10.224.79.71 with SMTP id o7mr10703157qak.36.1381322366331; Wed, 09 Oct 2013 05:39:26 -0700 (PDT) Received: by 10.140.27.4 with HTTP; Wed, 9 Oct 2013 05:39:26 -0700 (PDT) Received: by 10.140.27.4 with HTTP; Wed, 9 Oct 2013 05:39:26 -0700 (PDT) In-Reply-To: <658CDA0F8466BC4FA160446B17B8C7B613A894A4@LTCFISWMSGMB12.FNFIS.com> References: <658CDA0F8466BC4FA160446B17B8C7B613A894A4@LTCFISWMSGMB12.FNFIS.com> Date: Wed, 9 Oct 2013 18:09:26 +0530 Message-ID: Subject: Re: Can we reduce/fix number of mappers in Hive From: Rajesh Balamohan To: user@hive.apache.org Content-Type: multipart/alternative; boundary=047d7bf0f31ef733a904e84e2cad X-Virus-Checked: Checked by ClamAV on apache.org --047d7bf0f31ef733a904e84e2cad Content-Type: text/plain; charset=UTF-8 Did you try adjusting fileinputformat. Min and max size parameters? On Oct 9, 2013 5:51 PM, "Garg, Rinku" wrote: > Hi All**** > > We did a successful setup of hadoop-0.20.203.0 and hive-0.7.1. We have > the following query:**** > > ** ** > > Is there any option in Hive where mappers can be reduced/fixed?**** > > ** ** > > For example if there are 8 mapping tasks defined in Hadoop configuration, > then is it possible to use 4 hive setups that uses 2 mappers each?**** > > ** ** > > Thanks & Regards,**** > > Rinku Garg > > > **** > > ** ** > > ** ** > > ** ** > _____________ > The information contained in this message is proprietary and/or > confidential. If you are not the intended recipient, please: (i) delete the > message and all copies; (ii) do not disclose, distribute or use the message > in any manner; and (iii) notify the sender immediately. In addition, please > be aware that any message addressed to our domain is subject to archiving > and review by persons other than the intended recipient. Thank you. > --047d7bf0f31ef733a904e84e2cad Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable

Did you try adjusting fileinputformat. Min and max size parameters?

On Oct 9, 2013 5:51 PM, "Garg, Rinku" = <Rinku.Garg@fisglobal.com> wrote:

Hi All<= u>

We did = a successful setup of hadoop-0.20.203.0 and hive-0.7.1. =C2=A0We have the f= ollowing query:

= =C2=A0

Is there any option in Hive where mappers can be redu= ced/fixed?

=C2=A0

For example if there are 8 mapping tasks defined in H= adoop configuration, then is it possible to use 4 hive setups that uses 2 m= appers each?

= =C2=A0

Thanks = & Regards,

Rinku Garg

=C2=A0=

=C2=A0

=C2=A0

_____________
The information contained in this message is proprietary and/or confidentia= l. If you are not the intended recipient, please: (i) delete the message an= d all copies; (ii) do not disclose, distribute or use the message in any ma= nner; and (iii) notify the sender immediately. In addition, please be aware= that any message addressed to our domain is subject to archiving and revie= w by persons other than the intended recipient. Thank you.
--047d7bf0f31ef733a904e84e2cad--