hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-7678) Ability to enable logging of container memory stats
Date Thu, 04 Jan 2018 16:38:00 GMT

    [ https://issues.apache.org/jira/browse/YARN-7678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16311606#comment-16311606

Hudson commented on YARN-7678:

SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13449 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/13449/])
YARN-7678. Ability to enable logging of container memory stats. (jlowe: rev d795661868e330ac55d6ac7b0ee62fb658e03ff7)
* (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/monitor/ContainersMonitorImpl.java

> Ability to enable logging of container memory stats
> ---------------------------------------------------
>                 Key: YARN-7678
>                 URL: https://issues.apache.org/jira/browse/YARN-7678
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: nodemanager
>    Affects Versions: 2.8.0, 3.0.0
>            Reporter: Jim Brennan
>            Assignee: Jim Brennan
>         Attachments: YARN-7678-branch-2.001.patch, YARN-7678.001.patch
> YARN-3424 changed logging of memory stats from ContainersMonitorImpl to INFO to DEBUG.
> We have found these log messages to be useful information in Out-of-Memory situations
- they provide detail that helps show the memory profile of the container over time, which
can be helpful in determining root cause.
> Here's an example message from YARN-3424:
> {noformat}
> 2015-03-27 09:32:48,905 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl:
Memory usage of ProcessTree 9215 for container-id container_1427462602546_0002_01_000008:
189.8 MB of 1 GB physical memory used; 2.6 GB of 2.1 GB virtual memory used
> {noformat}
> Propose to change this to use a separate logger for this message, so that we can enable
debug logging for this without enabling all of the other debug logging for ContainersMonitorImpl.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org

View raw message