hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sreekanth Ramakrishnan (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-4854) Capacity Scheduler should read the reclaim-capacity-interval config value from its own config file
Date Fri, 12 Dec 2008 16:46:44 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-4854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Sreekanth Ramakrishnan updated HADOOP-4854:
-------------------------------------------

    Attachment: HADOOP-4854-2.patch

Attaching latest patch incorporating Vivek's comment.

I am returning a large value from FakeResourceManager class, so the reclaim capacity interval
would be large enough not to interfere for all the tests.

> Capacity Scheduler should read the reclaim-capacity-interval config value from its own
config file
> --------------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-4854
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4854
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: contrib/capacity-sched
>            Reporter: Vivek Ratan
>            Assignee: Sreekanth Ramakrishnan
>            Priority: Minor
>         Attachments: HADOOP-4854-1.patch, HADOOP-4854-2.patch
>
>
> The Capacity Scheduler needs to know the time interval for checking whether capacity
needs to be reclaimed. This is represented by the static variable RECLAIM_CAPACITY_INTERVAL.
This value is currently read as follows: 
> {code}
>     RECLAIM_CAPACITY_INTERVAL = conf.getLong("mapred.capacity-scheduler.reclaimCapacity.interval",
5);
> {code}
> This is incorrect for the following reasons: 
> * ""mapred.capacity-scheduler.reclaimCapacity.interval" is not present in any of the
config files: hadoop-site.xml or capacity-scheduler.xml.
> * "mapred.capacity-scheduler.reclaimCapacity.interval" should be specified in the scheduler's
config file, capacity-scheduler.xml. It should be read through org.apache.hadoop.mapred.CapacitySchedulerConf.

> * The Forrest documentation for the Capacity Scheduler should describe this setting.
We should probably create a new sub-section under 'Configuration', titled 'Configuring properties
for the Scheduler'. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message