hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Srikanth Kandula (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (YARN-4056) Bundling: Searching for multiple containers in a single pass over {queues, applications, priorities}
Date Sun, 16 Aug 2015 23:11:46 GMT

     [ https://issues.apache.org/jira/browse/YARN-4056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Srikanth Kandula updated YARN-4056:
-----------------------------------
    Description: 
More than one container is allocated on many NM heartbeats. Yet, the current scheduler allocates
exactly one container per iteration over {{queues, applications, priorities}}. When there
are many queues, applications, or priorities allocating only one container per iteration can
 needlessly increase the duration of the NM heartbeat.
 
In this JIRA, we propose bundling. That is, allow arbitrarily many containers to be allocated
in a single iteration over {queues, applications and priorities}.

  was:
More than one container is allocated on many NM heartbeats. Yet, the current scheduler allocates
exactly one container per iteration over {queues, applications, priorities}. When there are
many queues, applications, or priorities allocating only one container per iteration can 
needlessly increase the duration of the NM heartbeat.
 
In this JIRA, we propose bundling. That is, allow arbitrarily many containers to be allocated
in a single iteration over {queues, applications and priorities}.


> Bundling: Searching for multiple containers in a single pass over {queues, applications,
priorities}
> ----------------------------------------------------------------------------------------------------
>
>                 Key: YARN-4056
>                 URL: https://issues.apache.org/jira/browse/YARN-4056
>             Project: Hadoop YARN
>          Issue Type: New Feature
>          Components: capacityscheduler, resourcemanager, scheduler
>            Reporter: Srikanth Kandula
>         Attachments: bundling.docx
>
>
> More than one container is allocated on many NM heartbeats. Yet, the current scheduler
allocates exactly one container per iteration over {{queues, applications, priorities}}. When
there are many queues, applications, or priorities allocating only one container per iteration
can  needlessly increase the duration of the NM heartbeat.
>  
> In this JIRA, we propose bundling. That is, allow arbitrarily many containers to be allocated
in a single iteration over {queues, applications and priorities}.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message