hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Karthik Kambatla (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-2882) Add ExecutionType to denote if a container execution is GUARANTEED or QUEUEABLE
Date Tue, 15 Dec 2015 09:43:46 GMT

    [ https://issues.apache.org/jira/browse/YARN-2882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15057717#comment-15057717
] 

Karthik Kambatla commented on YARN-2882:
----------------------------------------

In YARN-1011, we plan to allocate resources based on utilization. We need a similar differentiation
- guaranteed and opportunistic. If the guaranteed containers end up using all allocated resources,
the opportunistic containers are to be preempted. For this preemption, we might want to set
cgroups and OOM Killer priorities for these opportunistic containers differently. 

Comments/questions:
# Do the opportunistic containers in YARN-1011 and here share characteristics enough to be
the same? If yes, can we call them opportunistic instead of queueable. Otherwise, we are probably
better off calling them queueable. 
# To set the cgroups and OOM priorities, we need the type in container initialization context.
I am fine with adding it in this patch or later. 
# We are considering developing YARN-1011 also on a branch. Any ideas on how we can share
code? May be, deliberate more on the container execution type and commit it to trunk itself?


I would like to do a more thorough review of the patch here once we finalize on these items
and I am more awake :)

> Add ExecutionType to denote if a container execution is GUARANTEED or QUEUEABLE
> -------------------------------------------------------------------------------
>
>                 Key: YARN-2882
>                 URL: https://issues.apache.org/jira/browse/YARN-2882
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: nodemanager, resourcemanager
>            Reporter: Konstantinos Karanasos
>            Assignee: Konstantinos Karanasos
>         Attachments: YARN-2882-yarn-2877.001.patch, YARN-2882-yarn-2877.002.patch, yarn-2882.patch
>
>
> This JIRA introduces the notion of container types.
> We propose two initial types of containers: guaranteed-start and queueable containers.
> Guaranteed-start are the existing containers, which are allocated by the central RM and
are instantaneously started, once allocated.
> Queueable is a new type of container, which allows containers to be queued in the NM,
thus their execution may be arbitrarily delayed.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message