hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Arun C Murthy <ar...@yahoo-inc.com>
Subject Re: run multiple MR jobs concurrently?
Date Thu, 15 Nov 2007 18:05:30 GMT

On Thu, Nov 15, 2007 at 11:54:09AM -0500, Toby DiPasquale wrote:
>Hi all,
>Am I missing something here? I fire up 4 MR jobs on a cluster, giving
>each job one reducer and 1/4 of the available mappers, and only one of
>them runs at once. Is there something special I have to do to get them
>to run concurrently? Thanks for any help.

The JobTracker just picks a task of the highest priority job in it's queue and assigns a task
from that job to a TaskTracker. 
Assuming all your jobs are of the same priority I'm not very surprised at that behaviour...


>Toby DiPasquale

View raw message