hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Konstantinos Karanasos (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-6703) Add flag to allow MapReduce AM to request for OPPORTUNISTIC containers
Date Fri, 20 May 2016 00:09:12 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-6703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15292402#comment-15292402
] 

Konstantinos Karanasos commented on MAPREDUCE-6703:
---------------------------------------------------

Hi [~jianhe],
This particular change in the MR AM is for people to start trying out OPPORTUNISTIC containers
and distributed scheduling.
However, you can find some of our initial experimental results on some internal workloads
(consisting of both short and long tasks) in our paper here: http://research.microsoft.com/pubs/244469/mercury-atc2015.pdf.

> Add flag to allow MapReduce AM to request for OPPORTUNISTIC containers
> ----------------------------------------------------------------------
>
>                 Key: MAPREDUCE-6703
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6703
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>            Reporter: Arun Suresh
>            Assignee: Arun Suresh
>         Attachments: MAPREDUCE-6703.001.patch
>
>
> YARN-2882 and YARN-4335 introduces the concept of container ExecutionTypes and specifically
OPPORTUNISTIC containers.
> The default ExecutionType is GUARANTEED. This JIRA proposes to allow users to provide
hints via config to the MR framework as to the number of containers it would like to schedule
as OPPORTUNISTIC.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-help@hadoop.apache.org


Mime
View raw message