ambari-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sid Wagle" <swa...@hortonworks.com>
Subject Re: Review Request 26818: Create Metrics Load Simulator
Date Thu, 16 Oct 2014 20:00:13 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/26818/
-----------------------------------------------------------

(Updated Oct. 16, 2014, 8 p.m.)


Review request for Ambari and Myroslav Papirkovskyy.


Bugs: AMBARI-7818
    https://issues.apache.org/jira/browse/AMBARI-7818


Repository: ambari


Description
-------

We need a way of simulating a cluster pushing metrics into the metrics service. The goal is
to create a standalone load generation application that:

* Can be run independently on multiple nodes
* Takes arguments that control number of threads that emit data (each thread functions as
a separate node)
* Accepts configuration of where to send the data (REST endpoint)
* Generates random data within acceptable ranges for metrics coming from Hadoop metrics sink
and Host Metrics Monitor (i.e. should use valid metric names so metrics can be surfaced within
Ambari Dashboard.

This service will be used to validate the current POC work as well as system/acceptance testing.


Diffs (updated)
-----

  ambari-metrics/ambari-metrics-hadoop-timelineservice/pom.xml e1f11c9 
  ambari-metrics/ambari-metrics-hadoop-timelineservice/src/main/assemblies/simulator.xml PRE-CREATION

  ambari-metrics/ambari-metrics-hadoop-timelineservice/src/main/conf/simulator-log4j.xml PRE-CREATION

  ambari-metrics/ambari-metrics-hadoop-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/loadsimulator/LoadRunner.java
PRE-CREATION 
  ambari-metrics/ambari-metrics-hadoop-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/loadsimulator/MetricsLoadSimulator.java
PRE-CREATION 
  ambari-metrics/ambari-metrics-hadoop-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/loadsimulator/MetricsSenderWorker.java
PRE-CREATION 
  ambari-metrics/ambari-metrics-hadoop-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/loadsimulator/data/AppID.java
PRE-CREATION 
  ambari-metrics/ambari-metrics-hadoop-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/loadsimulator/data/AppMetrics.java
PRE-CREATION 
  ambari-metrics/ambari-metrics-hadoop-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/loadsimulator/data/ApplicationInstance.java
PRE-CREATION 
  ambari-metrics/ambari-metrics-hadoop-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/loadsimulator/data/HostMetricsGenerator.java
PRE-CREATION 
  ambari-metrics/ambari-metrics-hadoop-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/loadsimulator/data/Metric.java
PRE-CREATION 
  ambari-metrics/ambari-metrics-hadoop-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/loadsimulator/data/MetricsGeneratorConfigurer.java
PRE-CREATION 
  ambari-metrics/ambari-metrics-hadoop-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/loadsimulator/net/MetricsSender.java
PRE-CREATION 
  ambari-metrics/ambari-metrics-hadoop-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/loadsimulator/net/RestMetricsSender.java
PRE-CREATION 
  ambari-metrics/ambari-metrics-hadoop-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/loadsimulator/net/StdOutMetricsSender.java
PRE-CREATION 
  ambari-metrics/ambari-metrics-hadoop-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/loadsimulator/net/UrlService.java
PRE-CREATION 
  ambari-metrics/ambari-metrics-hadoop-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/loadsimulator/util/Json.java
PRE-CREATION 
  ambari-metrics/ambari-metrics-hadoop-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/loadsimulator/util/RandomMetricsProvider.java
PRE-CREATION 
  ambari-metrics/ambari-metrics-hadoop-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/loadsimulator/util/TimeStampProvider.java
PRE-CREATION 
  ambari-metrics/ambari-metrics-hadoop-timelineservice/src/main/resources/metrics_def/DATANODE.dat
PRE-CREATION 
  ambari-metrics/ambari-metrics-hadoop-timelineservice/src/main/resources/metrics_def/HOST.dat
PRE-CREATION 
  ambari-metrics/ambari-metrics-hadoop-timelineservice/src/main/resources/metrics_def/MASTER_HBASE.dat
PRE-CREATION 
  ambari-metrics/ambari-metrics-hadoop-timelineservice/src/main/resources/metrics_def/NAMENODE.dat
PRE-CREATION 
  ambari-metrics/ambari-metrics-hadoop-timelineservice/src/main/resources/metrics_def/NODEMANAGER.dat
PRE-CREATION 
  ambari-metrics/ambari-metrics-hadoop-timelineservice/src/main/resources/metrics_def/RESOURCEMANAGER.dat
PRE-CREATION 
  ambari-metrics/ambari-metrics-hadoop-timelineservice/src/main/resources/metrics_def/SLAVE_HBASE.dat
PRE-CREATION 
  ambari-metrics/ambari-metrics-hadoop-timelineservice/src/main/resources/scripts/start.sh
PRE-CREATION 
  ambari-metrics/ambari-metrics-hadoop-timelineservice/src/main/resources/scripts/start_slaves.sh
PRE-CREATION 
  ambari-metrics/ambari-metrics-hadoop-timelineservice/src/main/resources/scripts/status_slaves.sh
PRE-CREATION 
  ambari-metrics/ambari-metrics-hadoop-timelineservice/src/main/resources/scripts/stop.sh
PRE-CREATION 
  ambari-metrics/ambari-metrics-hadoop-timelineservice/src/main/resources/scripts/stop_slaves.sh
PRE-CREATION 
  ambari-metrics/ambari-metrics-hadoop-timelineservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/loadsimulator/data/TestAppMetrics.java
PRE-CREATION 
  ambari-metrics/ambari-metrics-hadoop-timelineservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/loadsimulator/data/TestMetric.java
PRE-CREATION 
  ambari-metrics/ambari-metrics-hadoop-timelineservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/loadsimulator/net/TestRestMetricsSender.java
PRE-CREATION 
  ambari-metrics/ambari-metrics-hadoop-timelineservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/loadsimulator/net/TestStdOutMetricsSender.java
PRE-CREATION 
  ambari-metrics/ambari-metrics-hadoop-timelineservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/loadsimulator/util/TestRandomMetricsProvider.java
PRE-CREATION 
  ambari-metrics/ambari-metrics-hadoop-timelineservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/loadsimulator/util/TestTimeStampProvider.java
PRE-CREATION 
  pom.xml 5544ef5 

Diff: https://reviews.apache.org/r/26818/diff/


Testing
-------


Thanks,

Sid Wagle


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message