hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Junping Du (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (YARN-313) Add Admin API for supporting node resource configuration in command line
Date Fri, 11 Mar 2016 14:06:59 GMT

     [ https://issues.apache.org/jira/browse/YARN-313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Junping Du updated YARN-313:
----------------------------
    Release Note: 
After this patch, the feature to support NM resource dynamically configuration is completed,
so that user can configure NM with new resource without bring NM down or decommissioned.
Two CLIs are provided to support update resources on individual node or a batch of nodes:
1. Update resource on single node: yarn rmadmin -updateNodeResource [NodeID] [MemSize] [vCores]

2. Update resource on a batch of nodes: yarn rmadmin -refreshNodesResources, that reflect
nodes' resource configuration defined in dynamic-resources.xml which is loaded by RM dynamically
(like capacity-scheduler.xml or fair-scheduler.xml). 
The first version of configuration format is:
<configuration>
  <property>
    <name>yarn.resource.dynamic.nodes</name>
    <value>h1:1234</value>
  </property>
  <property>
    <name>yarn.resource.dynamic.h1:1234.vcores</name>
    <value>16</value>
  </property>
  <property>
    <name>yarn.resource.dynamic.h1:1234.memory</name>
    <value>1024</value>
  </property>
</configuration> 

  was:
Since this patch, we are providing CLI to support NM resource dynamically configuration that
user can configure NM with new resource without bring NM down or decommissioned.
Two CLIs are provided to support update resources on individual node or a batch of nodes:
1. Update resource on single node: yarn rmadmin -updateNodeResource [NodeID] [MemSize] [vCores]

2. Update resource on a batch of nodes: yarn rmadmin -refreshNodesResources, that reflect
nodes' resource configuration defined in dynamic-resources.xml, the format of configuration
is get optimized in YARN-4160.


> Add Admin API for supporting node resource configuration in command line
> ------------------------------------------------------------------------
>
>                 Key: YARN-313
>                 URL: https://issues.apache.org/jira/browse/YARN-313
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: client, graceful
>            Reporter: Junping Du
>            Assignee: Inigo Goiri
>            Priority: Critical
>             Fix For: 2.8.0
>
>         Attachments: YARN-313-sample.patch, YARN-313-v1.patch, YARN-313-v10.patch, YARN-313-v11.patch,
YARN-313-v2.patch, YARN-313-v3.patch, YARN-313-v4.patch, YARN-313-v5.patch, YARN-313-v6.patch,
YARN-313-v7.patch, YARN-313-v8.patch, YARN-313-v9.patch
>
>
> We should provide some admin interface, e.g. "yarn rmadmin -refreshResources" to support
changes of node's resource specified in a config file.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message