hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vinod Kumar Vavilapalli (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-1003) Add a maxContainersPerNode config to the Fair Scheduler
Date Thu, 01 Aug 2013 06:25:48 GMT

    [ https://issues.apache.org/jira/browse/YARN-1003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13726101#comment-13726101
] 

Vinod Kumar Vavilapalli commented on YARN-1003:
-----------------------------------------------

I guess you are referring to restricting the number of tasks per node *per job*. If so, the
implementation was always a hack in MR1. It was first wrongly put outside the scheduler, and
then pushed into FairScheduler as devs behind FS wanted the feature atleast in FS as there
was no correct way to do it in MR1/JT. 

The correct way to do this now with YARN is to implement it inside the AM. That's what users
always wanted really, to restrict this job to run say only one task per node.
                
> Add a maxContainersPerNode config to the Fair Scheduler
> -------------------------------------------------------
>
>                 Key: YARN-1003
>                 URL: https://issues.apache.org/jira/browse/YARN-1003
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: scheduler
>    Affects Versions: 2.1.0-beta
>            Reporter: Sandy Ryza
>            Assignee: Karthik Kambatla
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message