ambari-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dmytro Sen" <d...@hortonworks.com>
Subject Review Request 21291: Yarn Nodemanager Metrics only update every few minutes
Date Fri, 09 May 2014 22:36:47 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/21291/
-----------------------------------------------------------

Review request for Ambari and Mahadev Konar.


Bugs: AMBARI-5607
    https://issues.apache.org/jira/browse/AMBARI-5607


Repository: ambari


Description
-------

Yarn Nodemanager Metrics take far too long between updates.

To demonstrate:

Run Terasort or anything that runs mapreduce:
{code}
hdfs dfs -mkdir -p benchmarks/terasort
hadoop jar /usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar teragen -Dmapred.map.tasks=72
-Dmapred.reduce.tasks=36  1000000 benchmarks/terasort/input
hadoop jar /usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar terasort -Dmapred.map.tasks=72
-Dmapred.reduce.tasks=36 benchmarks/terasort/input benchmarks/terasort/output
hdfs dfs -rm -R -skipTrash benchmarks/terasort
{code}
Then repeatedly probe the API at:
{noformat}https://<server>:8081/api/v1/clusters/c1/services/YARN/components/NODEMANAGER?fields=host_components/metrics/yarn{noformat}
It usually takes 2-3 minutes to see the metrics update, very repeatable.


Diffs
-----

  ambari-server/src/main/resources/stacks/HDP/1.3.2/services/GANGLIA/package/files/rrd.py
3fe6901 
  ambari-server/src/main/resources/stacks/HDP/2.0.6/services/GANGLIA/package/files/rrd.py
3fe6901 

Diff: https://reviews.apache.org/r/21291/diff/


Testing
-------

Manually, on newly deployed cluster.


Thanks,

Dmytro Sen


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message