flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "shuai.xu (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FLINK-7928) Extend the filed in ResourceProfile for precisely calculating the resource of a task manager
Date Thu, 26 Oct 2017 03:24:00 GMT
shuai.xu created FLINK-7928:
-------------------------------

             Summary: Extend the filed in ResourceProfile for precisely calculating the resource
of a task manager
                 Key: FLINK-7928
                 URL: https://issues.apache.org/jira/browse/FLINK-7928
             Project: Flink
          Issue Type: Improvement
          Components: JobManager, ResourceManager
            Reporter: shuai.xu
            Assignee: shuai.xu


ResourceProfile records all the resource requirements for a slot。It is generated by JobMaster
and then passed to ResourceManager with the slot request. 
A task in the slot needs three parts of resource: 
1. The resource for the operators, this is specified by the ResourceSpec user defined 
2. The resource for the operators to communicating with their upstreams. For example, the
resource for buffer pools and so on.
3. The resource for the operators to communicating with their downstreams. Same as above.
So ResourceProfile should contain three parts of resource, the first part from ResouceSpec,
and the other two part be generated by Job Master.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message