airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Siddharth Anand (JIRA)" <j...@apache.org>
Subject [jira] [Closed] (AIRFLOW-49) xcom_pull with "task_ids=None" returns items not upstream
Date Thu, 05 May 2016 15:55:12 GMT

     [ https://issues.apache.org/jira/browse/AIRFLOW-49?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Siddharth Anand closed AIRFLOW-49.
----------------------------------

> xcom_pull with "task_ids=None" returns items not upstream
> ---------------------------------------------------------
>
>                 Key: AIRFLOW-49
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-49
>             Project: Apache Airflow
>          Issue Type: Bug
>    Affects Versions: Airflow 1.7.0
>            Reporter: Adam Mustafa
>            Assignee: Siddharth Anand
>            Priority: Minor
>
> {code}
> dag = airflow.DAG(
>     "TestingError",
>     start_date=datetime(2015, 1, 1),
>     schedule_interval="@once",
>     default_args=args)
> def foo(**kwargs):
>     return "Foo Ran"
> def bar(**kwargs):
>     logging.info(kwargs['ti'].xcom_pull(task_ids=None))
>     return "Bar Ran"
> def baz(**kwargs):
>     return "Baz Ran"
> task1 = airflow.operators.PythonOperator(task_id='Foo', dag=dag, provide_context=True,
python_callable=foo)
> task2 = airflow.operators.PythonOperator(task_id='Bar1', dag=dag, provide_context=True,
python_callable=bar)
> task3 = airflow.operators.PythonOperator(task_id='Baz', dag=dag, provide_context=True,
python_callable=baz)
> task4 = airflow.operators.PythonOperator(task_id='Bar2', dag=dag, provide_context=True,
python_callable=bar)
> task1.set_downstream(task2)
> task1.set_downstream(task3)
> task3.set_downstream(task4)
> {code}
> Using the SequentialExecuter,the tasks execute in this order:
> Foo, Baz, Bar1, Bar2
> When you look in the logs, the log for task "Bar1" prints out "Baz Ran" even though that
task is not upstream. 
> It seems that since there was no "task_ids" assigned when pulling from xcom, it just
searched all the returned values, instead searching for those that were just upstream. This
means that tasks are affected by items that are not upstream. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message