hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Dunning <tdunn...@veoh.com>
Subject Re: Limiting Total # of TaskTracker threads
Date Wed, 19 Mar 2008 00:53:04 GMT

I think the original request was to limit the sum of maps and reduces rather
than limiting the two parameters independently.

Clearly, with a single job running at a time, this is a non-issue since
reducers don't do much until the maps are done.  With multiple jobs it is a
bit more of an issue.

On 3/18/08 5:26 PM, "Arun C Murthy" <arunc@yahoo-inc.com> wrote:

>> I'd like to limit the total # of threads on a task tracker (think
>> limited resources on a given compute node) to a given number, and
>> there does not appear to be a way to do that anymore. Am I correct
>> in my understanding that there is no capability to do this?
> The map/reduce tasks are not threads, they are run in separate JVMs
> which are forked by the tasktracker.

View raw message