hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Naganarasimha G R (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (YARN-3717) Improve debug-ability of Node Labels
Date Tue, 26 May 2015 15:34:17 GMT

     [ https://issues.apache.org/jira/browse/YARN-3717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Naganarasimha G R updated YARN-3717:
    Attachment: RMLogsForHungJob.log

Attaching the grep RM logs for the hung App, as the resources for the labels are not available.
This is more visible when a queue's accessible label does not specify default partition(but
by default its accessible) and user submit to this queue with out specifying partition. If
no node is under default partition then the job will be hung

> Improve debug-ability of Node Labels
> ------------------------------------
>                 Key: YARN-3717
>                 URL: https://issues.apache.org/jira/browse/YARN-3717
>             Project: Hadoop YARN
>          Issue Type: Improvement
>            Reporter: Naganarasimha G R
>            Assignee: Naganarasimha G R
>         Attachments: RMLogsForHungJob.log
> Few improvements which i want to suggest are : 
> 1> Add the default-node-Label expression for each queue in WebUI 
> 2> In Application/Appattempt page  show the app configured node label expression for
AM and Job (may be we need to store in ATS too)
> 3> RM log for the application ID which has hung has been attached, it is difficult
to analyze as there is no information related to the labels in it . I was intending to add
> "2015-05-26 00:19:25,681 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue:
Application added - appId: application_1432579630889_0001 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@35b4193e,
leaf-queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications:
0 #queue-active-applications: 1" open for suggestions for adding Info logs

This message was sent by Atlassian JIRA

View raw message