hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Konstantinos Karanasos (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (YARN-2882) Introducing container types
Date Wed, 25 Nov 2015 04:28:11 GMT

     [ https://issues.apache.org/jira/browse/YARN-2882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Konstantinos Karanasos updated YARN-2882:
-----------------------------------------
    Attachment: YARN-2882-yarn-2877.001.patch

I am uploading a new version of the patch for the GUARANTEED/QUEUEABLE containers.

Based on offline discussions with [~asuresh], [~chris.douglas], [~curino], [~subru] and [~sriramsrao],
we decided to not extend the ContainerType (used to differentiate between AM and plain tasks;
see YARN-3116) to include the GUARANTEED/QUEUEABLE containers distinction.

Instead, we are introducing a new enum type, the *ExecutionType*, to denote whether a container
will be GUARANTEED or QUEUEABLE.

The main reason behind this decision is that it allows us to characterize a container as GUARANTEED
or QUEUEABLE, regardless of whether it is an AM container or a plain task. Thus, the ExecutionType
is now orthogonal to the ContainerType of YARN-3116.
Moreover, this differentiation makes it easier to extend the system in the future by adding
new Execution Types.

Note that ExecutionType is used in both the ResourceRequest (for the AM to specify the desired
execution/scheduling type) and the ContainerTokenIdentifier (used to determine the way a container
is actually executed in the NM).

> Introducing container types
> ---------------------------
>
>                 Key: YARN-2882
>                 URL: https://issues.apache.org/jira/browse/YARN-2882
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: nodemanager, resourcemanager
>            Reporter: Konstantinos Karanasos
>            Assignee: Konstantinos Karanasos
>         Attachments: YARN-2882-yarn-2877.001.patch, yarn-2882.patch
>
>
> This JIRA introduces the notion of container types.
> We propose two initial types of containers: guaranteed-start and queueable containers.
> Guaranteed-start are the existing containers, which are allocated by the central RM and
are instantaneously started, once allocated.
> Queueable is a new type of container, which allows containers to be queued in the NM,
thus their execution may be arbitrarily delayed.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message