airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From GitBox <...@apache.org>
Subject [GitHub] [airflow-site] kaxil commented on a change in pull request #231: Add blogs for airflow DAGs testing
Date Fri, 03 Jan 2020 14:11:37 GMT
kaxil commented on a change in pull request #231: Add blogs for airflow DAGs testing
URL: https://github.com/apache/airflow-site/pull/231#discussion_r362821134
 
 

 ##########
 File path: landing-pages/site/content/en/blog/testing-in-airflow-part-1-dag-validation-tests-dag-definition-tests-and-unit-tests.md
 ##########
 @@ -0,0 +1,16 @@
+---
+title: "Testing in Airflow Part 1 - DAG Validation Tests DAG, Definition Tests and Unit Tests"
+linkTitle: "Testing in Airflow Part 1 - DAG Validation Tests, DAG Definition Tests and Unit
Tests"
+author: "Chandu Kavar"
+twitter: "chandukavar"
+github: "chandulal"
+linkedin: "chandu-kavar-627a209b"
+description: "To know how to test the validity of DAGs, typos, cyclicity, upstream and downstream
dependencies and custom operator/sensors."
+tags: ["Testing"]
+date: "2020-01-03"
+---
+Testing is an integral part of any software system to build confidence and increase the reliability
of the system. Recently, I joined Grab and here at Grab, we are using Airflow to create and
manage pipelines. But, we were facing issues with Airflow. I had a conversation with my engineering
manager and discussed on how we could make Airflow reliable and testable.
+Before Grab, I worked with ThoughtWorks. They are using TDD (Test Driven Development) methodology
in almost all the projects. As a matter of fact, everyone is very cognizant about testing.
This motivated me to explore testing in Airflow.
+I spent a weekend Googling. But, I didn’t find any good articles on airflow test covering
all the aspects, there are only a handful of articles available. I felt it’s worth to write
and share a blog on airflow testing.
+
+You can find more details on how to write these tests with examples in [Testing in Airflow
Part 1](https://blog.usejournal.com/testing-in-airflow-part-1-dag-validation-tests-dag-definition-tests-and-unit-tests-2aa94970570c?source=friends_link&sk=3e1ec0b1e5fcc1e9c258e08d260c7152).
 
 Review comment:
   Sorry, the content needs to entirely on the Airflow website.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

Mime
View raw message