airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Krishnaveni Mettu (JIRA)" <j...@apache.org>
Subject [jira] [Issue Comment Deleted] (AIRFLOW-338) BackfillJob is deadlocked
Date Wed, 27 Jul 2016 22:36:20 GMT

     [ https://issues.apache.org/jira/browse/AIRFLOW-338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Krishnaveni Mettu updated AIRFLOW-338:
--------------------------------------
    Comment: was deleted

(was: I just ran into this in our Dec env. Using 1.7.0. Created a new airflow Instance but
using the previous instance meta data and redis (celery) backend. 
)

> BackfillJob is deadlocked
> -------------------------
>
>                 Key: AIRFLOW-338
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-338
>             Project: Apache Airflow
>          Issue Type: Test
>          Components: DagRun
>    Affects Versions: Airflow 1.7.1.2
>         Environment: v1.7.1.2
>            Reporter: SARAVANAN SANKARANARAYANAN
>            Priority: Minor
>             Fix For: Airflow 1.7.1.2
>
>
> Hi,
> We are testing Airflow scheduler and getting deadlock error during backfill:-
> airflow backfill bwdc_il_abor_bcp_1 -s 2016-07-14T15:10:00 -e 2016-07-14T15:20:00
> [2016-07-14 15:08:27,249] {__init__.py:36} INFO - Using executor SequentialExecutor
> [2016-07-14 15:08:27,678] {models.py:154} INFO - Filling up the DagBag from /users/home/adcwq5r/airflow/dags
> [2016-07-14 15:08:32,789] {jobs.py:997} INFO - [backfill progress] | waiting: 0 | succeeded:
0 | kicked_off: 0 | failed: 0 | skipped: 0 | deadlocked: 21
> Traceback (most recent call last):
>   File "/usr/local/bin/airflow", line 15, in <module>
>     args.func(args)
>   File "/usr/local/lib/python2.7/site-packages/airflow/bin/cli.py", line 117, in backfill
>     pool=args.pool)
>   File "/usr/local/lib/python2.7/site-packages/airflow/models.py", line 3023, in run
>     job.run()
>   File "/usr/local/lib/python2.7/site-packages/airflow/jobs.py", line 173, in run
>     self._execute()
>   File "/usr/local/lib/python2.7/site-packages/airflow/jobs.py", line 1024, in _execute
>     raise AirflowException(err)
> airflow.exceptions.AirflowException: ---------------------------------------------------
> BackfillJob is deadlocked. These tasks were unable to run:



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message