hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Botong Huang (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (YARN-7317) Fix overallocation resulted from ceiling in LocalityMulticastAMRMProxyPolicy
Date Wed, 11 Oct 2017 21:14:00 GMT

     [ https://issues.apache.org/jira/browse/YARN-7317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Botong Huang updated YARN-7317:
    Attachment: YARN-7317.v1.patch

> Fix overallocation resulted from ceiling in LocalityMulticastAMRMProxyPolicy
> ----------------------------------------------------------------------------
>                 Key: YARN-7317
>                 URL: https://issues.apache.org/jira/browse/YARN-7317
>             Project: Hadoop YARN
>          Issue Type: Task
>            Reporter: Botong Huang
>            Assignee: Botong Huang
>            Priority: Minor
>         Attachments: YARN-7317.v1.patch
> When LocalityMulticastAMRMProxyPolicy is splitting up the ANY requests into different
subclusters, we are doing Ceil(N * weight), leading to overallocation overall. It is better
to do Floor(N * weight) for each subcluster and then assign the residue randomly according
to the weights. So that the total number of containers we ask from all subclusters sum up
to be N. 

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org

View raw message