hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ravi Prakash (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-3050) YarnScheduler needs to expose Resource Usage Information
Date Wed, 21 Sep 2011 22:07:28 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-3050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13112156#comment-13112156
] 

Ravi Prakash commented on MAPREDUCE-3050:
-----------------------------------------

Hi Bobby,

Looks great. :) Thanks for doing this :) My MR-2790 will be eternally grateful :-D

nitpicks:
# Why did you have to remove queueComparator from ParentQueue? You haven't changed the signature
of the constructor.
# YarnScheduler.java : the method name getApplication could be getSchedulerApp?


> YarnScheduler needs to expose Resource Usage Information
> --------------------------------------------------------
>
>                 Key: MAPREDUCE-3050
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3050
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: resourcemanager
>    Affects Versions: 0.23.0, 0.24.0
>            Reporter: Robert Joseph Evans
>            Assignee: Robert Joseph Evans
>            Priority: Blocker
>             Fix For: 0.23.0, 0.24.0
>
>         Attachments: MR-3050.txt
>
>
> Before the recent refactor The nodes had information in them about how much resources
they were using.  This information is not hidden inside SchedulerNode.  Similarly resource
usage information about an application, or in aggregate is only available through the Scheduler
and there is not interface to pull it out.
> We need to expose APIs to get Resource and Container information from the scheduler,
in aggregate across the entire cluster, per application, per node, and ideally also per queue
if applicable (although there are no JIRAs I am aware of that need this right now).

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message