hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gangl, Michael E (388K)" <Michael.E.Ga...@jpl.nasa.gov>
Subject Re: Is there an any way to change the number of reduce jobs on a local hadoop job
Date Fri, 29 Oct 2010 18:15:23 GMT
I believe you can only do this if you run in pseudo-distributed mode:



On 10/29/10 11:10 AM, "Steve Lewis" <lordjoe2000@gmail.com> wrote:

I frequently run small versions of my Hadoop jobs as local single machine
jobs to debug my logic.
When I do this I always get only a single reduce task even when I call
setNumReduceTasks with, say 10.

I want to debug some issues with the number of reducers and wonder if there
is a way to force local
hadoop jobs to emulate multiple reduce tasks

Steven M. Lewis PhD
4221 105th Ave Ne
Kirkland, WA 98033
206-384-1340 (cell)
Institute for Systems Biology
Seattle WA

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message