hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-7610) Extend Distributed Shell to support launching job with opportunistic containers
Date Wed, 06 Dec 2017 10:14:00 GMT

    [ https://issues.apache.org/jira/browse/YARN-7610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16279961#comment-16279961
] 

Hudson commented on YARN-7610:
------------------------------

SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13335 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/13335/])
YARN-7610. Extend Distributed Shell to support launching job with (wwei: rev 40b0045ebe0752cd3d1d09be00acbabdea983799)
* (add) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/OpportunisticContainers.md.vm
* (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/main/java/org/apache/hadoop/yarn/applications/distributedshell/Client.java
* (delete) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/OpportunisticContainers.md
* (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/main/java/org/apache/hadoop/yarn/applications/distributedshell/ApplicationMaster.java
* (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/test/java/org/apache/hadoop/yarn/applications/distributedshell/TestDistributedShell.java


> Extend Distributed Shell to support launching job with opportunistic containers
> -------------------------------------------------------------------------------
>
>                 Key: YARN-7610
>                 URL: https://issues.apache.org/jira/browse/YARN-7610
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: applications/distributed-shell
>            Reporter: Weiwei Yang
>            Assignee: Weiwei Yang
>         Attachments: YARN-7610.001.patch, YARN-7610.002.patch, YARN-7610.003.patch, YARN-7610.004.patch,
YARN-7610.005.patch, added_doc.png, outline_compare.png
>
>
> Per doc in [https://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/OpportunisticContainers.html#Running_a_Sample_Job],
user can run some of PI job mappers as O containers. Similarly, propose to extend distributed
shell to support specifying the container type, it will be very helpful for testing. Propose
to add following argument
> {code}
> $./bin/yarn org.apache.hadoop.yarn.applications.distributedshell.Client
> -container_type <arg>                          Container execution type,
>                                                 GUARANTEED or
>                                                 OPPORTUNISTIC
> {code}
> Implication: all containers in a distributed shell job will be launching as user-specified
container type (except for AM), if not given, default type is {{GUARANTEED}}. AM is always
launched as {{GUARANTEED}} container.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message