hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Karthik Kambatla (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (MAPREDUCE-4518) FairScheduler: PoolSchedulable#updateDemand() - potential redundant aggregation
Date Mon, 13 Aug 2012 19:28:38 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-4518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Karthik Kambatla updated MAPREDUCE-4518:

    Attachment: trunk-MR-4518.patch

Updated the patch for trunk
- Added constructor to FSQueueSchedulable for testing purposes
- Test checks if the demand is less than or equal to maxResources
- Verified right number of iterations via the logs in the loop in updateDemand()
> FairScheduler: PoolSchedulable#updateDemand() - potential redundant aggregation
> -------------------------------------------------------------------------------
>                 Key: MAPREDUCE-4518
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4518
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: contrib/fair-share
>    Affects Versions: 1.0.3
>            Reporter: Karthik Kambatla
>            Assignee: Karthik Kambatla
>         Attachments: MR-4518_branch1.patch, trunk-MR-4518.patch, trunk-MR-4518.patch
> In FS, PoolSchedulable#updateDemand() limits the demand to maxTasks only after iterating
though all the pools and computing the final demand. 
> By checking if the demand has reached maxTasks in every iteration, we can avoid redundant
work, at the expense of one condition check every iteration.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message