hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Roni Burd (JIRA)" <j...@apache.org>
Subject [jira] [Created] (YARN-6418) Reduce Resource object creation and overhead in Capacity scheduler inner loop
Date Thu, 30 Mar 2017 23:44:41 GMT
Roni Burd created YARN-6418:
-------------------------------

             Summary: Reduce Resource object creation and overhead in Capacity scheduler inner
loop
                 Key: YARN-6418
                 URL: https://issues.apache.org/jira/browse/YARN-6418
             Project: Hadoop YARN
          Issue Type: Improvement
          Components: capacityscheduler, resourcemanager
    Affects Versions: 3.0.0-alpha2, 2.8.1
            Reporter: Roni Burd
            Assignee: Roni Burd


Resource object is used multiple due to ResourceCalculator creates new instances on every
method call. This gets called several times on each node HB. Resource is a very expensive
object that relies on Protobufs 

The change is to remove the need to use protobuf on the Resource object and avoid creating
many objects in the Resource Calculator all the time



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message