Return-Path: X-Original-To: apmail-hive-user-archive@www.apache.org Delivered-To: apmail-hive-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 7F0E09866 for ; Fri, 27 Apr 2012 20:49:14 +0000 (UTC) Received: (qmail 46844 invoked by uid 500); 27 Apr 2012 20:49:13 -0000 Delivered-To: apmail-hive-user-archive@hive.apache.org Received: (qmail 46758 invoked by uid 500); 27 Apr 2012 20:49:13 -0000 Mailing-List: contact user-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hive.apache.org Delivered-To: mailing list user@hive.apache.org Received: (qmail 46749 invoked by uid 99); 27 Apr 2012 20:49:13 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 27 Apr 2012 20:49:13 +0000 X-ASF-Spam-Status: No, hits=-0.1 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_MED,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: local policy) Received: from [143.112.68.14] (HELO mckesson.com) (143.112.68.14) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 27 Apr 2012 20:49:05 +0000 Received: from ([139.177.6.216]) by ndhaxpcsm02.mckesson.com with ESMTP id BRHVRH1.274155926; Fri, 27 Apr 2012 16:48:42 -0400 Received: by smtpout.hboc.com with Internet Mail Service (5.5.2658.27) id ; Fri, 27 Apr 2012 16:48:21 -0400 Received: from ddce3010.na.corp.mckesson.com (mckmail.access-health.com [10.7.40.23]) by atlexcsmtpa.hboc.com with SMTP (Microsoft Exchange Internet Mail Service Version 5.5.2658.27) id JYT999A4; Fri, 27 Apr 2012 16:48:10 -0400 Received: from NDHV3004.na.corp.mckesson.com ([10.122.21.103]) by ddce3010.na.corp.mckesson.com with Microsoft SMTPSVC(6.0.3790.4675); Fri, 27 Apr 2012 13:48:26 -0700 From: "Ryabin, Thomas" To: user@hive.apache.org X-MimeOLE: Produced By Microsoft Exchange V6.5 Content-class: Produced By Microsoft Exchange V6.5 X-MS-Has-Attach: Produced By Microsoft Exchange V6.5 Thread-Topic: Produced By Microsoft Exchange V6.5 Thread-Index: Produced By Microsoft Exchange V6.5 X-OriginalArrivalTime: Produced By Microsoft Exchange V6.5 X-MimeOLE: Produced By Microsoft Exchange V6.5 Content-class: urn:content-classes:message MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----_=_NextPart_001_01CD24B7.17EA7E9A" Subject: How to make the query compiler not determine the number of reducers? Date: Fri, 27 Apr 2012 16:48:25 -0400 Message-ID: <515C20036F2D164EB2FFC3F476962D9B0FA65CEB@NDHV3004.na.corp.mckesson.com> X-MS-Has-Attach: X-MS-TNEF-Correlator: Thread-Topic: How to make the query compiler not determine the number of reducers? Thread-Index: Ac0ktxdfKgDeHH2RQ4enbDc4Tx3n2Q== X-OriginalArrivalTime: 27 Apr 2012 20:48:26.0809 (UTC) FILETIME=[18403A90:01CD24B7] X-Virus-Checked: Checked by ClamAV on apache.org This is a multi-part message in MIME format. ------_=_NextPart_001_01CD24B7.17EA7E9A Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Hi, =20 When I run a query that uses a custom UDF I made, one of the lines it prints out is: Number of reduce tasks determined at compile time: 1 =20 And this causes the MapReduce job to have only 1 reducer. Is there a = way to make it so the compiler does not determine the number of reduce = tasks to create, so I can specify the number myself? =20 The query in question is: select test_udf(name, store) from employees join stores; =20 Thanks, Thomas ------_=_NextPart_001_01CD24B7.17EA7E9A Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable

Hi,

When I run = a query that uses a custom UDF I made, one of the lines it prints out = is:

Number of reduce = tasks determined at compile time: 1

And this = causes the MapReduce job to have only 1 reducer. Is there a way to make = it so the compiler does not determine the number of reduce tasks to = create, so I can specify the number myself?

The query = in question is:

select = test_udf(name, store) from employees join = stores;

Thanks,

Thomas

------_=_NextPart_001_01CD24B7.17EA7E9A--