samza-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Christopher Chamberlin <chris.chamber...@climate.com>
Subject monitoring best practices
Date Thu, 25 Jun 2015 21:22:56 GMT
I see in the Samza metrics documentation that there are two basic ways to
get metrics from Samza to a metrics repository: 1) write a custom
MetricsReporter to push the metrics directly, perhaps using an
ExecutorService or similar to perform batching, or 2) consume the metrics
Kafka queue and push them from there, letting the built-in
MetricsSnapshotReporter do the batching.

Can anyone running Samza in production provide any insight into which of
these to prefer?

I'm looking to get my metrics out to Prometheus, probably via a Pushgateway
endpoint.

I see the pending SAMZA-340 patch to add Graphite support using approach
#1. I like going directly from the monitored container to the monitoring
system (fewer moving parts than going via Kafka in method #2), but I'd
rather not re-implement the batching and other logic in the existing
SnapshotMetricsReporter.

Thanks.

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message