ambari-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dmitro Lisnichenko" <dlysniche...@hortonworks.com>
Subject Re: Review Request 21291: Yarn Nodemanager Metrics only update every few minutes
Date Mon, 12 May 2014 15:55:41 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/21291/#review42701
-----------------------------------------------------------

Ship it!


Ship It!

- Dmitro Lisnichenko


On May 12, 2014, 3:51 p.m., Dmytro Sen wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/21291/
> -----------------------------------------------------------
> 
> (Updated May 12, 2014, 3:51 p.m.)
> 
> 
> Review request for Ambari, Dmitro Lisnichenko and Mahadev Konar.
> 
> 
> Bugs: AMBARI-5607
>     https://issues.apache.org/jira/browse/AMBARI-5607
> 
> 
> Repository: ambari
> 
> 
> Description
> -------
> 
> Yarn Nodemanager Metrics take far too long between updates.
> 
> To demonstrate:
> 
> Run Terasort or anything that runs mapreduce:
> {code}
> hdfs dfs -mkdir -p benchmarks/terasort
> hadoop jar /usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar teragen -Dmapred.map.tasks=72
-Dmapred.reduce.tasks=36  1000000 benchmarks/terasort/input
> hadoop jar /usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar terasort -Dmapred.map.tasks=72
-Dmapred.reduce.tasks=36 benchmarks/terasort/input benchmarks/terasort/output
> hdfs dfs -rm -R -skipTrash benchmarks/terasort
> {code}
> Then repeatedly probe the API at:
> {noformat}https://<server>:8081/api/v1/clusters/c1/services/YARN/components/NODEMANAGER?fields=host_components/metrics/yarn{noformat}
> It usually takes 2-3 minutes to see the metrics update, very repeatable.
> 
> 
> Diffs
> -----
> 
>   ambari-server/src/main/resources/stacks/HDP/1.3.2/services/GANGLIA/package/files/rrd.py
3fe6901 
>   ambari-server/src/main/resources/stacks/HDP/2.0.6/services/GANGLIA/package/files/rrd.py
3fe6901 
> 
> Diff: https://reviews.apache.org/r/21291/diff/
> 
> 
> Testing
> -------
> 
> Manually, on newly deployed cluster.
> 
> 
> Thanks,
> 
> Dmytro Sen
> 
>


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message