hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arun Suresh (JIRA)" <j...@apache.org>
Subject [jira] [Created] (YARN-5501) Container Pooling in YARN
Date Tue, 09 Aug 2016 23:46:20 GMT
Arun Suresh created YARN-5501:
---------------------------------

             Summary: Container Pooling in YARN
                 Key: YARN-5501
                 URL: https://issues.apache.org/jira/browse/YARN-5501
             Project: Hadoop YARN
          Issue Type: Improvement
            Reporter: Arun Suresh


This JIRA proposes a method for reducing the container launch latency in YARN. It introduces
a notion of pooling *Unattached Pre-Initialized Containers*.

Proposal in brief:
* Have a *Pre-Initialized Container Factory* service within the NM to create these unattached
containers.
* The NM would then advertise these containers as special resource types (this should be possible
via YARN-3926).
* When a start container request is received by the node manager for launching a container
requesting this specific type of resource, it will take one of these unattached pre-initialized
containers from the pool, and use it to service the container request.
* Once the request is complete, the pre-initialized container would be released and ready
to serve another request.

This capability would help reduce container launch latencies and thereby allow for development
of more interactive applications on YARN.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message