hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Wangda Tan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-4161) Capacity Scheduler : Assign single or multiple containers per heart beat driven by configuration
Date Wed, 19 Jul 2017 22:01:00 GMT

    [ https://issues.apache.org/jira/browse/YARN-4161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16093868#comment-16093868
] 

Wangda Tan commented on YARN-4161:
----------------------------------

Thanks [~ywskycn], in general the patch looks good to me. And could you open a follow up JIRA
to track documentation changes (or add them to the same JIRA if you like). Now we have 3 knobs
to control #containers allocated for each node heartbeat. It's better to clearly document
them.

> Capacity Scheduler : Assign single or multiple containers per heart beat driven by configuration
> ------------------------------------------------------------------------------------------------
>
>                 Key: YARN-4161
>                 URL: https://issues.apache.org/jira/browse/YARN-4161
>             Project: Hadoop YARN
>          Issue Type: New Feature
>          Components: capacity scheduler
>            Reporter: Mayank Bansal
>            Assignee: Mayank Bansal
>              Labels: oct16-medium
>         Attachments: YARN-4161.002.patch, YARN-4161.003.patch, YARN-4161.004.patch, YARN-4161.005.patch,
YARN-4161.patch, YARN-4161.patch.1
>
>
> Capacity Scheduler right now schedules multiple containers per heart beat if there are
more resources available in the node.
> This approach works fine however in some cases its not distribute the load across the
cluster hence throughput of the cluster suffers. I am adding feature to drive that using configuration
by that we can control the number of containers assigned per heart beat.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message