hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Naganarasimha G R (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-4670) add logging when a node is AM-blacklisted
Date Thu, 04 Feb 2016 06:31:39 GMT

    [ https://issues.apache.org/jira/browse/YARN-4670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15131820#comment-15131820

Naganarasimha G R commented on YARN-4670:

 YARN-3946 informs if the app's AM is stuck and if it misses to schedule on a node due to
its blacklisting for launching AM's for this app.
bq. Regarding logging in SchedulerAppUtils.isBlackListed(), does that get used for the AM
blacklisting too? It's not obvious to me. 
*SchedulerAppUtils.isBlackListed* -> *SchedulerApplicationAttempt.isBlackListed* ->
*AppSchedulingInfo.isBlackListed* and finally in the last call they are checking for the AM
black list so in a way logging is there but as you said its not too obvious.
??volume of logging?? depends on the number of nodes which are free and and how many are blacklisted
for the application and how long other nodes are occupied. but IMO it would be rare scenario
volume explodes and we can have logging for it in *AppSchedulingInfo.isBlackListed* , Thoughts

> add logging when a node is AM-blacklisted
> -----------------------------------------
>                 Key: YARN-4670
>                 URL: https://issues.apache.org/jira/browse/YARN-4670
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: resourcemanager
>    Affects Versions: 2.8.0
>            Reporter: Sangjin Lee
>            Assignee: Sangjin Lee
>            Priority: Trivial
> Today there is not much logging happening when a node is blacklisted for an AM (see YARN-2005).
We can add a little more logging to see this activity easily from the RM logs.

This message was sent by Atlassian JIRA

View raw message