hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ChenFolin (JIRA)" <j...@apache.org>
Subject [jira] [Created] (YARN-4980) SchedulerEventDispatcher should not process by only a single EventProcessor thread
Date Thu, 21 Apr 2016 06:59:25 GMT
ChenFolin created YARN-4980:
-------------------------------

             Summary: SchedulerEventDispatcher should not process by only a single EventProcessor
thread
                 Key: YARN-4980
                 URL: https://issues.apache.org/jira/browse/YARN-4980
             Project: Hadoop YARN
          Issue Type: Bug
          Components: resourcemanager
    Affects Versions: 2.6.4, 2.5.0
         Environment: 1 resourcemanager
500 nodemanager
nodemanager heartbeat interval is 3 secs.

            Reporter: ChenFolin


I think only a single EventProcessor thread in SchedulerEventDispatcher to process event is
unreasonable.

I often see "Size of scheduler event-queue is 1000(2000..)..." at the resourcemanager log.

Now I have 500 nodemanager , event process is slowly. If I  add another 200 nodemanagers ,
the situation will badly.

... so,can node events(node add/delete/update...) processed by multi threads?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message