hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Radim Kolar (JIRA)" <j...@apache.org>
Subject [jira] [Created] (MAPREDUCE-4256) Improve resource scheduling
Date Mon, 14 May 2012 15:47:53 GMT
Radim Kolar created MAPREDUCE-4256:

             Summary: Improve resource scheduling
                 Key: MAPREDUCE-4256
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4256
             Project: Hadoop Map/Reduce
          Issue Type: Improvement
          Components: resourcemanager
            Reporter: Radim Kolar
             Fix For: 2.0.0, 3.0.0

Currently resource manager supports only Memory resource during container allocation.

I propose following improvements:

1. add support for CPU utilization. Node CPU used information can be obtained by ResourceCalculatorPlugin.

2. add support for custom resources. In node configuration will be something like:

name=node.resource.GPU, value=1 (node has 1 GPU).

If job will need to use GPU for computation, it will add "GPU=1" requirement to its job config
and Resource Manager will allocate container on node with GPU available.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message