hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arun C Murthy (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (YARN-1375) RM logs get filled with scheduler monitor logs when we enable scheduler monitoring
Date Mon, 24 Feb 2014 20:39:25 GMT

     [ https://issues.apache.org/jira/browse/YARN-1375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Arun C Murthy updated YARN-1375:
--------------------------------

    Fix Version/s:     (was: 2.3.0)
                   2.4.0

> RM logs get filled with scheduler monitor logs when we enable scheduler monitoring
> ----------------------------------------------------------------------------------
>
>                 Key: YARN-1375
>                 URL: https://issues.apache.org/jira/browse/YARN-1375
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: resourcemanager
>    Affects Versions: 2.3.0
>            Reporter: Devaraj K
>            Assignee: haosdent
>             Fix For: 2.4.0
>
>         Attachments: YARN-1375.patch
>
>
> When we enable scheduler monitor, it is filling the RM logs with the same queue states
periodically. We can log only when any difference with the previous state instead of logging
the same message. 
> {code:xml}
> 2013-10-30 23:30:08,464 INFO org.apache.hadoop.yarn.server.resourcemanager.monitor.capacity.ProportionalCapacityPreemptionPolicy:
 QUEUESTATE: 1383156008464, a, 5120, 5, 508928, 497, 4096, 4, 5120, 5, 0, 0, 0, 0, b, 3072,
3, 0, 0, 4096, 4, 3072, 3, 0, 0, 0, 0
> 2013-10-30 23:30:11,464 INFO org.apache.hadoop.yarn.server.resourcemanager.monitor.capacity.ProportionalCapacityPreemptionPolicy:
 QUEUESTATE: 1383156011464, a, 5120, 5, 508928, 497, 4096, 4, 5120, 5, 0, 0, 0, 0, b, 3072,
3, 0, 0, 4096, 4, 3072, 3, 0, 0, 0, 0
> 2013-10-30 23:30:14,465 INFO org.apache.hadoop.yarn.server.resourcemanager.monitor.capacity.ProportionalCapacityPreemptionPolicy:
 QUEUESTATE: 1383156014465, a, 5120, 5, 508928, 497, 4096, 4, 5120, 5, 0, 0, 0, 0, b, 3072,
3, 0, 0, 4096, 4, 3072, 3, 0, 0, 0, 0
> 2013-10-30 23:30:17,466 INFO org.apache.hadoop.yarn.server.resourcemanager.monitor.capacity.ProportionalCapacityPreemptionPolicy:
 QUEUESTATE: 1383156017466, a, 5120, 5, 508928, 497, 4096, 4, 5120, 5, 0, 0, 0, 0, b, 3072,
3, 0, 0, 4096, 4, 3072, 3, 0, 0, 0, 0
> 2013-10-30 23:30:20,466 INFO org.apache.hadoop.yarn.server.resourcemanager.monitor.capacity.ProportionalCapacityPreemptionPolicy:
 QUEUESTATE: 1383156020466, a, 5120, 5, 508928, 497, 4096, 4, 5120, 5, 0, 0, 0, 0, b, 3072,
3, 0, 0, 4096, 4, 3072, 3, 0, 0, 0, 0
> 2013-10-30 23:30:23,467 INFO org.apache.hadoop.yarn.server.resourcemanager.monitor.capacity.ProportionalCapacityPreemptionPolicy:
 QUEUESTATE: 1383156023467, a, 5120, 5, 508928, 497, 4096, 4, 5120, 5, 0, 0, 0, 0, b, 3072,
3, 0, 0, 4096, 4, 3072, 3, 0, 0, 0, 0
> 2013-10-30 23:30:26,468 INFO org.apache.hadoop.yarn.server.resourcemanager.monitor.capacity.ProportionalCapacityPreemptionPolicy:
 QUEUESTATE: 1383156026467, a, 5120, 5, 508928, 497, 4096, 4, 5120, 5, 0, 0, 0, 0, b, 3072,
3, 0, 0, 4096, 4, 3072, 3, 0, 0, 0, 0
> 2013-10-30 23:30:29,468 INFO org.apache.hadoop.yarn.server.resourcemanager.monitor.capacity.ProportionalCapacityPreemptionPolicy:
 QUEUESTATE: 1383156029468, a, 5120, 5, 508928, 497, 4096, 4, 5120, 5, 0, 0, 0, 0, b, 3072,
3, 0, 0, 4096, 4, 3072, 3, 0, 0, 0, 0
> 2013-10-30 23:30:32,469 INFO org.apache.hadoop.yarn.server.resourcemanager.monitor.capacity.ProportionalCapacityPreemptionPolicy:
 QUEUESTATE: 1383156032469, a, 5120, 5, 508928, 497, 4096, 4, 5120, 5, 0, 0, 0, 0, b, 3072,
3, 0, 0, 4096, 4, 3072, 3, 0, 0, 0, 0
> {code}



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Mime
View raw message