hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arun Suresh (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (YARN-6692) Delay pause when container is localizing
Date Mon, 05 Jun 2017 23:54:12 GMT

    [ https://issues.apache.org/jira/browse/YARN-6692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037865#comment-16037865
] 

Arun Suresh edited comment on YARN-6692 at 6/5/17 11:53 PM:
------------------------------------------------------------

This situation cannot really happen, since, after YARN-4597, container queuing happens only
AFTER the localization completes. Since queuing happens before running, and only running containers
can be paused, it will not be possible to pause a container during localization.

There might be some deployments where the localization of opportunistic containers must also
be delayed till right before running (essentially, localize after queuing - which would be
how it was done earlier with the QueueingContainerManager). To address these use-cases, we
should probably first raise a JIRA to introduce a configuration flag, based on which the NM
can decide if queuing should happen before or after localization, then have this JIRA depend
on that.



was (Author: asuresh):
This situation cannot really happen, since, after YARN-4597, container queuing happens only
AFTER the localization completes. Since queuing happens before running, and only running containers
can be paused, it will not be possible to pause a container during localization.

There might be some deployments where the localization of opportunistic containers must also
be delayed till right before running (essentially, localize after queuing - which would be
how it was done earlier with the QueueingContainerManager). For these situations, we should
probably first raise a JIRA to introduce a configuration flag, based on which the NM can decide
if queuing should happen before or after localization, then have this JIRA depend on that.


> Delay pause when container is localizing
> ----------------------------------------
>
>                 Key: YARN-6692
>                 URL: https://issues.apache.org/jira/browse/YARN-6692
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: nodemanager
>            Reporter: Jose Miguel Arreola
>            Assignee: Jose Miguel Arreola
>   Original Estimate: 96h
>  Remaining Estimate: 96h
>
> If a container receives a Pause event while localizing, allow container finish localizing
and then pause it



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message