hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Weiwei Yang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-7610) Extend Distributed Shell to support launching job with opportunistic containers
Date Wed, 06 Dec 2017 07:47:00 GMT

    [ https://issues.apache.org/jira/browse/YARN-7610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16279796#comment-16279796
] 

Weiwei Yang commented on YARN-7610:
-----------------------------------

Thanks for the +1 [~asuresh], the patch has whitespace issue, I will fix that in v4 and once
I get a clean jenkins result I will commit this to branch-2.9, branch-3.0 and trunk. Thanks
for the review all along.

> Extend Distributed Shell to support launching job with opportunistic containers
> -------------------------------------------------------------------------------
>
>                 Key: YARN-7610
>                 URL: https://issues.apache.org/jira/browse/YARN-7610
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: applications/distributed-shell
>            Reporter: Weiwei Yang
>            Assignee: Weiwei Yang
>         Attachments: YARN-7610.001.patch, YARN-7610.002.patch, YARN-7610.003.patch, added_doc.png,
outline_compare.png
>
>
> Per doc in [https://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/OpportunisticContainers.html#Running_a_Sample_Job],
user can run some of PI job mappers as O containers. Similarly, propose to extend distributed
shell to support specifying the container type, it will be very helpful for testing. Propose
to add following argument
> {code}
> $./bin/yarn org.apache.hadoop.yarn.applications.distributedshell.Client
> -container_type <arg>                          Container execution type,
>                                                 GUARANTEED or
>                                                 OPPORTUNISTIC
> {code}
> Implication: all containers in a distributed shell job will be launching as user-specified
container type (except for AM), if not given, default type is {{GUARANTEED}}. AM is always
launched as {{GUARANTEED}} container.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message