airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Austin Hsu (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (AIRFLOW-2906) DataDog Integration for Airflow
Date Wed, 15 Aug 2018 21:19:00 GMT

     [ https://issues.apache.org/jira/browse/AIRFLOW-2906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Austin Hsu updated AIRFLOW-2906:
--------------------------------
    Description: Add functionality to Airflow to enable sending of metrics to DataDog.  DataDog
provides support for tags which allows us to aggregate data more easily and visualize it. 
We can utilize the [Datadog python library|https://github.com/DataDog/datadogpy] python library
and the [Datadog ThreadStats module|https://datadogpy.readthedocs.io/en/latest/#datadog-threadstats-module]
to send metrics directly to DataDog without needing to spin up an agent to forward the metrics.  The
current implementation in 1.8 uses the statsd library to send the metrics which provides us
with much less control to filter our data.  (was: Add functionality to Airflow to enable sending
of metrics to DataDog.  DataDog provides support for tags which allows us to aggregate data
more easily and visualize it.  We can utilize the [Datadog python library|https://github.com/DataDog/datadogpy]
python library and the [Datadog ThreadStats module|https://datadogpy.readthedocs.io/en/latest/#datadog-threadstats-module]
to send metrics directly to DataDog without needing to spin up an agent to forward the metrics.  The
current implementation in 1.8 uses the statsd library to send the metrics which )

> DataDog Integration for Airflow
> -------------------------------
>
>                 Key: AIRFLOW-2906
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-2906
>             Project: Apache Airflow
>          Issue Type: Improvement
>          Components: utils
>    Affects Versions: Airflow 1.8
>            Reporter: Austin Hsu
>            Assignee: Austin Hsu
>            Priority: Minor
>              Labels: metrics
>
> Add functionality to Airflow to enable sending of metrics to DataDog.  DataDog provides
support for tags which allows us to aggregate data more easily and visualize it.  We can
utilize the [Datadog python library|https://github.com/DataDog/datadogpy] python library and
the [Datadog ThreadStats module|https://datadogpy.readthedocs.io/en/latest/#datadog-threadstats-module]
to send metrics directly to DataDog without needing to spin up an agent to forward the metrics.  The
current implementation in 1.8 uses the statsd library to send the metrics which provides us
with much less control to filter our data.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message