Mailing-List: contact common-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: common-user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of ives.aerts@gmail.com
 designates 209.85.222.198 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:sender:in-reply-to:references:date
         :x-google-sender-auth:message-id:subject:from:to:content-type;
        b=hzJ111xovmqLIRrH9+d/5frp1xw3hd3yFMsuXJZ6D7+d/lAge/ca3OuUNVpBB47dny
         vrAi1U+D7FL94HE+RMnJ85Hd4lkvfAAICoPKomOXjP8Nci1AwYrG17kUDE5C4Gn6GaWO
         iZYoOh3uNlp55FMBwBMo+bfMGlJnMzwmup2Fc=
MIME-Version: 1.0
Sender: ives.aerts@gmail.com
In-Reply-To: <3F5C026C-70AC-4BFA-A61F-6B566F0279E4@apache.org>
References: <976b682b0912170206qc06e283me287ee6c69fe4007@mail.gmail.com>
	 <3F5C026C-70AC-4BFA-A61F-6B566F0279E4@apache.org>
Date: Fri, 18 Dec 2009 13:24:36 +0100
Message-ID: <976b682b0912180424l4ef5d705oebeafb9f4777bce8@mail.gmail.com>
Subject: Re: Running only node-local jobs
From: Ives Aerts <ives.aerts+hadoop@gmail.com>
To: common-user@hadoop.apache.org
Content-Type: text/plain; charset=ISO-8859-1

On Thu, Dec 17, 2009 at 8:24 PM, Owen O'Malley <omalley@apache.org> wrote:
> On Dec 17, 2009, at 2:06 AM, Ives Aerts wrote:
]>> Quick question: is it possible to configure a job such that its map
>> tasks will only run node-local?
>
> No, that is currently not possible without writing your own scheduler.

Too bad. Now I wouldn't mind writing my own scheduler (or subclassing
an existing one) and plugging it in but I had a quick look and it
seems that an important part of the task scheduling logic is actually
contained in the JobInProgress class which is instantiated by the
JobTracker. So even if I replace the scheduler I won't be able to
override that part of the functionality. Or am I missing something?

-- 
Cheers,
-Ives