Return-Path: X-Original-To: apmail-hadoop-yarn-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-yarn-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id B2DC2105F1 for ; Wed, 13 Nov 2013 18:01:30 +0000 (UTC) Received: (qmail 61767 invoked by uid 500); 13 Nov 2013 18:01:27 -0000 Delivered-To: apmail-hadoop-yarn-issues-archive@hadoop.apache.org Received: (qmail 61653 invoked by uid 500); 13 Nov 2013 18:01:26 -0000 Mailing-List: contact yarn-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: yarn-issues@hadoop.apache.org Delivered-To: mailing list yarn-issues@hadoop.apache.org Received: (qmail 61024 invoked by uid 99); 13 Nov 2013 18:01:26 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 13 Nov 2013 18:01:26 +0000 Date: Wed, 13 Nov 2013 18:01:26 +0000 (UTC) From: "Alejandro Abdelnur (JIRA)" To: yarn-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (YARN-1040) De-link container life cycle from the process and add ability to execute multiple processes in the same long-lived container MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/YARN-1040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13821597#comment-13821597 ] Alejandro Abdelnur commented on YARN-1040: ------------------------------------------ [~bikassaha], if I got it right, you suggest: * {{StartContainerRequest}} would have a new property {{boolean multipleProcesses (false)}} * An additional API {{startProcess(ContainerId, ContainerLaunchContext)}} will be used to start multiple processes within the same container. * In a {{StartContainerRequest}}, if the {{ContainerLaunchContext == null}} and {{multipleProcesses = true}}, the container is started with no associated process and the container allocation will not timeout as it as been claimed by the AM (because of the start container request). If that is the case, then YARN-1404 would be a special case of this JIRA. Am i right? > De-link container life cycle from the process and add ability to execute multiple processes in the same long-lived container > ---------------------------------------------------------------------------------------------------------------------------- > > Key: YARN-1040 > URL: https://issues.apache.org/jira/browse/YARN-1040 > Project: Hadoop YARN > Issue Type: Sub-task > Components: nodemanager > Affects Versions: 3.0.0 > Reporter: Steve Loughran > > The AM should be able to exec >1 process in a container, rather than have the NM automatically release the container when the single process exits. > This would let an AM restart a process on the same container repeatedly, which for HBase would offer locality on a restarted region server. > We may also want the ability to exec multiple processes in parallel, so that something could be run in the container while a long-lived process was already running. This can be useful in monitoring and reconfiguring the long-lived process, as well as shutting it down. -- This message was sent by Atlassian JIRA (v6.1#6144)