airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dinesh Sharma (JIRA)" <j...@apache.org>
Subject [jira] [Created] (AIRFLOW-420) Airflow allows passing of parameters to tasks in "test" mode. It should allow in "run" mode too
Date Thu, 11 Aug 2016 23:09:20 GMT
Dinesh Sharma created AIRFLOW-420:
-------------------------------------

             Summary: Airflow allows passing of parameters to tasks in "test" mode. It should
allow in "run" mode too
                 Key: AIRFLOW-420
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-420
             Project: Apache Airflow
          Issue Type: Improvement
            Reporter: Dinesh Sharma
            Priority: Critical


Hey guys,
I'm doing a POC on Airflow. Felt pretty excited initially about its capabilities after trying
out Luigi. But I'm puzzled as to why passing parameters is available in "test" mode but not
in "run" mode.
As a background, I'm not evaluating Airflow for any ETL or other data related purposes. I
need to setup a task that does a few different things based on parameters passed. I want to
be able to queue multiple instances of this task (with different input params) to run on different
dates/times e.g. sending out custom emails. But I also have a different task that needs to
clear/skip certain instances of this task that may still be in the queue. They need to be
cleared based on something that might happen between now and the execution time of those tasks.

I was thinking earlier that it may be accomplished by assigning task ids dynamically and passing
parameters. But looks like neither of those options are available at this time. Will appreciate
any input.
Thanks



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message