hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sunil G (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (YARN-4161) Capacity Scheduler : Assign single or multiple containers per heart beat driven by configuration
Date Thu, 29 Jun 2017 20:52:00 GMT

    [ https://issues.apache.org/jira/browse/YARN-4161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16068963#comment-16068963
] 

Sunil G edited comment on YARN-4161 at 6/29/17 8:51 PM:
--------------------------------------------------------

bq.Yes. so you ok with existing two config fields?
Yes. We can do two configs. Any other options with one config param may confuse user more.

bq.Yes, now checking is little confused. I refactored to more clearer.
Makes sene

bq.For now, I more prefer to do it in scheduler-level
Lets do this at scheduler level for now. I think we can extend to queue level a little later
when its really needed. Else it may complicate a little more.


was (Author: sunilg):
bq,Yes. so you ok with existing two config fields?
Yes. We can do two configs. Any other options with one config param may confuse user more.

bq.Yes, now checking is little confused. I refactored to more clearer.
Makes sene

bq.For now, I more prefer to do it in scheduler-level
Lets do this at scheduler level for now. I think we can extend to queue level a little later
when its really needed. Else it may complicate a little more.

> Capacity Scheduler : Assign single or multiple containers per heart beat driven by configuration
> ------------------------------------------------------------------------------------------------
>
>                 Key: YARN-4161
>                 URL: https://issues.apache.org/jira/browse/YARN-4161
>             Project: Hadoop YARN
>          Issue Type: New Feature
>          Components: capacity scheduler
>            Reporter: Mayank Bansal
>            Assignee: Mayank Bansal
>              Labels: oct16-medium
>         Attachments: YARN-4161.patch, YARN-4161.patch.1
>
>
> Capacity Scheduler right now schedules multiple containers per heart beat if there are
more resources available in the node.
> This approach works fine however in some cases its not distribute the load across the
cluster hence throughput of the cluster suffers. I am adding feature to drive that using configuration
by that we can control the number of containers assigned per heart beat.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message