Return-Path: X-Original-To: apmail-hadoop-common-user-archive@www.apache.org Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 31E9A9E2C for ; Wed, 18 Apr 2012 04:33:27 +0000 (UTC) Received: (qmail 49584 invoked by uid 500); 18 Apr 2012 04:33:23 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 49514 invoked by uid 500); 18 Apr 2012 04:33:22 -0000 Mailing-List: contact common-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-user@hadoop.apache.org Delivered-To: mailing list common-user@hadoop.apache.org Received: (qmail 49441 invoked by uid 99); 18 Apr 2012 04:33:21 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 18 Apr 2012 04:33:21 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (athena.apache.org: 209.85.210.176 is neither permitted nor denied by domain of corbin@tynt.com) Received: from [209.85.210.176] (HELO mail-iy0-f176.google.com) (209.85.210.176) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 18 Apr 2012 04:33:15 +0000 Received: by iagw33 with SMTP id w33so13407602iag.35 for ; Tue, 17 Apr 2012 21:32:54 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type :x-gm-message-state; bh=NUrfaUT6lHY542yrTQ2i5HNBMUwNyXboyzpYzntNXMI=; b=ZUNZUORVuqIz/o4XD7pwIhUlJkHvSjG/+xT/xIsOsnM4ALU2A0xCWUjyQ0qg4kjauk UN6xTR1MXvKMqI74ZckBmKCH+y6XIVImm4ejgwuxZmpc/BixFlB1VlHFSX81L5NiddYQ 8aP+utyk4LLR4ge5ySJbiK7eKSMOmoOIUt+Zn4wwRk6RmiVYDUK2Y1eeNi3HX/aH3nkS ItGIGEBDwY9uCg7JlFxqZtsSLbssWsT5sqonO90pMQBo8P3M7t574DaURYi22r7Q5V/t w97AfLuVSH7xFD0C7dgud4Dj9Dq3RktAjw5dwGrqJyNBGZTsUSXJmWq7UNNUl/iLdP7g 9b6Q== MIME-Version: 1.0 Received: by 10.50.77.138 with SMTP id s10mr486628igw.48.1334723574625; Tue, 17 Apr 2012 21:32:54 -0700 (PDT) Received: by 10.231.65.129 with HTTP; Tue, 17 Apr 2012 21:32:54 -0700 (PDT) Date: Tue, 17 Apr 2012 22:32:54 -0600 Message-ID: Subject: resource based scheduling - fairscheduler From: Corbin Hoenes To: common-user@hadoop.apache.org Content-Type: text/plain; charset=ISO-8859-1 X-Gm-Message-State: ALoCoQn+v0XmN9NiTE3pJ/al0hhn9Y+hyUAxOUnrxrYzitHQz9k14kpOnd46dwMbbIHbXKdvtWRs X-Virus-Checked: Checked by ClamAV on apache.org mapred.fairscheduler.loadmanager - An extension point that lets you specify a class that determines how many maps and reduces can run on a given TaskTracker. This class should implement the LoadManager interface. By default the task caps in the Hadoop config file are used, but this option could be used to make the load based on available memory and CPU utilization for example. Has someone implemented a loadmanager that does something similar to capacity scheduler's resource base scheduling? Even experimentally?