hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thomas Graves (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-365) Each NM heartbeat should not generate and event for the Scheduler
Date Thu, 07 Feb 2013 15:33:13 GMT

    [ https://issues.apache.org/jira/browse/YARN-365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13573592#comment-13573592
] 

Thomas Graves commented on YARN-365:
------------------------------------

Sorry Sid. I missed your comments and a few important points yesterday upon quick review.
 

By aggregating I meant the information in the heartbeat aggregated with all previous heartbeats
for that single node and then handled all at once in a single pass by the scheduler before
it tries to do any allocations.  Really its the same as your comment (which I missed yesterday)
"scheduler should really be pulling everything available in the node being processed.

I was originally thinking something along the lines of it having a single list for each completed
and launched containers that it would just add to rather then having the queue of the individual
completed and launched lists (one per heartbeat). But as long as the scheduler handles all
the updates in the queue before it tries to schedule you get the same affect.  I'll review
the current patch in more detail.

A few comments on the current patch:
- we don't need to add an update to the queue if there were no changes
- I don't think the current patch is handling all the updates in a single scheduler pass.


                
> Each NM heartbeat should not generate and event for the Scheduler
> -----------------------------------------------------------------
>
>                 Key: YARN-365
>                 URL: https://issues.apache.org/jira/browse/YARN-365
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: resourcemanager, scheduler
>    Affects Versions: 0.23.5
>            Reporter: Siddharth Seth
>            Assignee: Xuan Gong
>         Attachments: Prototype2.txt, Prototype3.txt, YARN-365.1.patch, YARN-365.2.patch,
YARN-365.3.patch
>
>
> Follow up from YARN-275
> https://issues.apache.org/jira/secure/attachment/12567075/Prototype.txt

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message