Mailing-List: contact yarn-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: yarn-issues@hadoop.apache.org
Date: Wed, 14 May 2014 06:08:15 +0000 (UTC)
From: "Mayank Bansal (JIRA)" <jira@apache.org>
To: yarn-issues@hadoop.apache.org
Message-ID: <JIRA.12714118.1400047579045.343861.1400047695111@arcas>
In-Reply-To: <JIRA.12714118.1400047579045@arcas>
References: <JIRA.12714118.1400047579045@arcas>
Subject: [jira] [Created] (YARN-2055) Preemtion: Jobs are failing due to AMs
 are getting launched and killed multiple times
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit

Mayank Bansal created YARN-2055:
-----------------------------------

             Summary: Preemtion: Jobs are failing due to AMs are getting launched and killed multiple times
                 Key: YARN-2055
                 URL: https://issues.apache.org/jira/browse/YARN-2055
             Project: Hadoop YARN
          Issue Type: Sub-task
          Components: resourcemanager
    Affects Versions: 2.4.0
            Reporter: Mayank Bansal
            Assignee: Sunil G


Cluster Size = 16GB [2NM's]
Queue A Capacity = 50%
Queue B Capacity = 50%
Consider there are 3 applications running in Queue A which has taken the full cluster capacity. 
J1 = 2GB AM + 1GB * 4 Maps
J2 = 2GB AM + 1GB * 4 Maps
J3 = 2GB AM + 1GB * 2 Maps

Another Job J4 is submitted in Queue B [J4 needs a 2GB AM + 1GB * 2 Maps ].
Currently in this scenario, Jobs J3 will get killed including its AM.

It is better if AM can be given least priority among multiple applications. In this same scenario, map tasks from J3 and J2 can be preempted.
Later when cluster is free, maps can be allocated to these Jobs.


--
This message was sent by Atlassian JIRA
(v6.2#6252)