Return-Path: X-Original-To: apmail-mahout-user-archive@www.apache.org Delivered-To: apmail-mahout-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 6B5C999C7 for ; Thu, 30 Aug 2012 07:15:08 +0000 (UTC) Received: (qmail 58642 invoked by uid 500); 30 Aug 2012 07:15:06 -0000 Delivered-To: apmail-mahout-user-archive@mahout.apache.org Received: (qmail 58490 invoked by uid 500); 30 Aug 2012 07:15:06 -0000 Mailing-List: contact user-help@mahout.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@mahout.apache.org Delivered-To: mailing list user@mahout.apache.org Received: (qmail 58455 invoked by uid 99); 30 Aug 2012 07:15:05 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 30 Aug 2012 07:15:05 +0000 X-ASF-Spam-Status: No, hits=1.8 required=5.0 tests=FREEMAIL_ENVFROM_END_DIGIT,FSL_RCVD_USER,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of rogerdai16@gmail.com designates 209.85.217.170 as permitted sender) Received: from [209.85.217.170] (HELO mail-lb0-f170.google.com) (209.85.217.170) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 30 Aug 2012 07:15:01 +0000 Received: by lbbgp3 with SMTP id gp3so638183lbb.1 for ; Thu, 30 Aug 2012 00:14:39 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=/NPeuTRPi92SUCSuz84fS4GcSjxqA0DjuCJ9Al0lIzU=; b=xvDSskxMYpjiR0nGWuL4LZpiXNZ+RKT0hFhwLqJeqba2FchsxVqf9xbZ3mvPWcojh7 D33IvXbL0vLoD96H/h89Fx9MQnb/aLwrY2FMMHsByCAqMR7VBPNEbeIF2mpqUzlgw8Cr apdEfd4HGlxNzcYuVMxX0moqZklCHiw2wkrnOvQJqA6+29mVH86W0FxKxC1TFa5xmHR6 s+wiD14+s1GYe99iB1xaXvInbzrLy4oayfElLrDg3jTne4hhySulYXua1ahF6JCRbcl2 yghdNOIFXhF18/MmzUMmXCvU4+9x1IHyT69S5Lhg7VblImLRN2Y+OPo/fZxI3oLz2Sxq J08Q== MIME-Version: 1.0 Received: by 10.152.135.147 with SMTP id ps19mr2320824lab.52.1346310879430; Thu, 30 Aug 2012 00:14:39 -0700 (PDT) Received: by 10.112.41.167 with HTTP; Thu, 30 Aug 2012 00:14:39 -0700 (PDT) In-Reply-To: <1C10D887-84B9-45A2-9C77-0FC7722A4B4B@me.com> References: <60CE0B66-1947-4EF0-A4E3-00C2A7C5E12B@gmail.com> <1C10D887-84B9-45A2-9C77-0FC7722A4B4B@me.com> Date: Thu, 30 Aug 2012 15:14:39 +0800 Message-ID: Subject: Re: Number of Reducers in PFP Growth is always 1 !!! From: =?GB2312?B?tPfH5eWw?= To: user@mahout.apache.org Content-Type: multipart/alternative; boundary=f46d042e0089b9c74104c8766d3e X-Virus-Checked: Checked by ClamAV on apache.org --f46d042e0089b9c74104c8766d3e Content-Type: text/plain; charset=GB2312 Content-Transfer-Encoding: quoted-printable PFP consists of three mapreduce jobs. which job did you modified? And do you mean the number of total reduce task or just reduce task that is running? Regards, Q 2012/8/30 C.V.Krishnakumar Iyer > Hi, > > I've already tried setting it in the code using job.setNumReduceTasks() > and conf.set("mapred.reduce.tasks","100"). > However, it does not seem to take the number of reducers at all, even for > the job that does parallel counting. Any advice would be appreciated. > Regards, > Krishnakumar. > On Aug 29, 2012, at 11:28 PM, =B4=F7=C7=E5=E5=B0 w= rote: > > > I doubt that you specify the config in hadoop config xml file. > > > > -- > > Regards, > > Q > > > > > > > > 2012/8/30 C.V. Krishnakumar Iyer > > > >> Hi, > >> > >> Quick question regarding PFPGrowth in Mahout 0.6: > >> > >> I see that there are no options to set the number of reducers in the > >> parallel counting phase of PFP Growth. It is just simple word count - = so > >> I'm guessing it should be parallelized. But for some reason it is not! > >> > >> Is that intentional? > >> > >> Regards, > >> Krishnakumar. > >> > > --f46d042e0089b9c74104c8766d3e--