hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Haibo Chen (JIRA)" <j...@apache.org>
Subject [jira] [Assigned] (MAPREDUCE-6501) Improve reducer preemption
Date Thu, 09 Feb 2017 00:26:43 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-6501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Haibo Chen reassigned MAPREDUCE-6501:
-------------------------------------

    Assignee: Gergő Pásztor  (was: Haibo Chen)

> Improve reducer preemption
> --------------------------
>
>                 Key: MAPREDUCE-6501
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6501
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: applicationmaster
>    Affects Versions: 2.7.1
>            Reporter: Karthik Kambatla
>            Assignee: Gergő Pásztor
>
> As discussed on MAPREDUCE-6302, we could improve the reducer preemption as follows:
> # preempt enough reducers so there are enough mappers to match slowstart 
> # prioritize preempting reducers that are still in SHUFFLE phase
> # add an option to not preempt reducers that are past SHUFFLE phase irrespective of slowstart
as long as one mapper can run
> We could do it all in one patch or create subtasks as necessary. 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-help@hadoop.apache.org


Mime
View raw message