airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "James Meickle (JIRA)" <j...@apache.org>
Subject [jira] [Created] (AIRFLOW-3230) Add an Airflow CLI command for rendering graphs
Date Thu, 18 Oct 2018 14:36:00 GMT
James Meickle created AIRFLOW-3230:
--------------------------------------

             Summary: Add an Airflow CLI command for rendering graphs
                 Key: AIRFLOW-3230
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-3230
             Project: Apache Airflow
          Issue Type: New Feature
            Reporter: James Meickle


In pull requests that modify Airflow DAG code, it would be helpful to have CI reports generate
before/after comparisons of the graph view. Currently, the Airflow CLI does not have the facility
to do this. The best option is "list_tasks --tree" which is really underwhelming. It's possible
to write a custom solution in graphviz using parsed DAG dependency data, but it will never
look/feel the same as Airflow's UI.

The graph code uses d3.js, which is included inside of a Python template. We probably need
to do something like:
 # Parse the DAG code
 # Write a representation to JSON
 # Render the template to HTML
 # Feed both files and an output location to something like this: [https://github.com/d3-node/d3-node]

This makes sense to install as a part of Airflow core, since it would be tightly coupled
to the current Airflow version's graph code; but since it would depend on JS execution not
installable via Python, it would likely need to raise a runtime error.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message