hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hemanth Yamijala (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-3479) Implement configuration items useful for Hadoop resource manager (v1)
Date Fri, 13 Jun 2008 05:52:45 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-3479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Hemanth Yamijala updated HADOOP-3479:
-------------------------------------

    Attachment: 3479.patch

The attached patch is a work-in-progress version of the resource manager configuration changes
following requirements in HADOOP-3421. It is incomplete and only intended to get some early
feedback on the basic approach.

The following changes are included:

- Introduced a *resource-manager-conf.xml* which will be the basic configuration file for
all resource manager related configuration. By default it ships with one default queue. The
values for the parameters in this queue may need to be relooked and decided carefully.
- Introduced a *hadoop.resource-manager.config* variable in hadoop-default.xml. User can specify
a name of a file for this variable.
- Introduced a *ResourceManagerConf* class which is responsible for parsing the config file
and exposing the configuration through basic APIs. The main APIs are:
{code}
Set<String> getQueues();
String get(String queueName, String propertyName);
{code}
There are convenience APIs for getting integers, booleans etc. More could be added.
- The ResoureManagerConf reads from either the value specified in hadoop.resource-manager.config
if defined, or from the resource-manager-conf.xml if the former is undefined.
- The ResourceManagerConf object is initialized from the JobTracker constructor and exposed
with a getter method. For illustration, I've just printed some LOG messages printing the queues
and the properties.

Unit tests, documentation and even API set need to be completed before the patch can be submitted.
If anyone feels strongly on an alternative approach, please comment now.

> Implement configuration items useful for Hadoop resource manager (v1)
> ---------------------------------------------------------------------
>
>                 Key: HADOOP-3479
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3479
>             Project: Hadoop Core
>          Issue Type: New Feature
>            Reporter: Hemanth Yamijala
>            Assignee: Hemanth Yamijala
>         Attachments: 3479.patch
>
>
> HADOOP-3421 lists requirements for a new resource manager for Hadoop. Implementation
for these will require support for new configuration items in Hadoop. This JIRA is to define
such configuration, and track it's implementation.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message