Mailing-List: contact yarn-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Date: Wed, 6 Dec 2017 06:39:00 +0000 (UTC)
From: "Arun Suresh (JIRA)" <jira@apache.org>
To: yarn-issues@hadoop.apache.org
Message-ID: <JIRA.13122799.1512462102000.395727.1512542340206@Atlassian.JIRA>
In-Reply-To: <JIRA.13122799.1512462102000@Atlassian.JIRA>
References: <JIRA.13122799.1512462102000@Atlassian.JIRA> <JIRA.13122799.1512462102934@jira-lw-us.apache.org>
Subject: [jira] [Comment Edited] (YARN-7610) Extend Distributed Shell to
 support launching job with opportunistic containers
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Wed, 06 Dec 2017 06:39:05 -0000


    [ https://issues.apache.org/jira/browse/YARN-7610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16279724#comment-16279724 ] 

Arun Suresh edited comment on YARN-7610 at 12/6/17 6:38 AM:
------------------------------------------------------------

Thanks for the update [~cheersyang]..

Since you are updating the documentation, can you also include the following [changes|https://github.com/apache/hadoop/commit/4e1fd7b022362ec7954b23d0ba6420dbc72a031b]. I had put them in when we released 2.9.0, but forgot to cherry-pick to branch-2.9 and above.

Since we are modifying the md to an md.vm, Can you also run mvn site and post a png of the updated section of the generated html page here. so we can verify if it looks good ?


was (Author: asuresh):
Thanks for the update [~cheersyang]..

Since you are updating the OpportunisticContainers.md.vm file, can you also include the following [changes|https://github.com/apache/hadoop/commit/4e1fd7b022362ec7954b23d0ba6420dbc72a031b]. I had put them in when we released 2.9.0, but forgot to cherry-pick to branch-2.9 and above.

Since we are modifying the md to an md.vm, Can you also run mvn site and post a png of the updated section of the generated html page here. so we can verify if it looks good ?

> Extend Distributed Shell to support launching job with opportunistic containers
> -------------------------------------------------------------------------------
>
>                 Key: YARN-7610
>                 URL: https://issues.apache.org/jira/browse/YARN-7610
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: applications/distributed-shell
>            Reporter: Weiwei Yang
>            Assignee: Weiwei Yang
>         Attachments: YARN-7610.001.patch, YARN-7610.002.patch
>
>
> Per doc in [https://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/OpportunisticContainers.html#Running_a_Sample_Job], user can run some of PI job mappers as O containers. Similarly, propose to extend distributed shell to support specifying the container type, it will be very helpful for testing. Propose to add following argument
> {code}
> $./bin/yarn org.apache.hadoop.yarn.applications.distributedshell.Client
> -container_type <arg>                          Container execution type,
>                                                 GUARANTEED or
>                                                 OPPORTUNISTIC
> {code}
> Implication: all containers in a distributed shell job will be launching as user-specified container type (except for AM), if not given, default type is {{GUARANTEED}}. AM is always launched as {{GUARANTEED}} container.


--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org