airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Darren Weber (Jira)" <j...@apache.org>
Subject [jira] [Updated] (AIRFLOW-5576) relation "variable" does not exist - psycopg2 - DagBag import
Date Tue, 01 Oct 2019 01:06:00 GMT

     [ https://issues.apache.org/jira/browse/AIRFLOW-5576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Darren Weber updated AIRFLOW-5576:
----------------------------------
    Description: 
While loading dags during a db-reset, before creating any DAG, some code attempts to get/set
a Variable, e.g.

```

{{val = Variable.get(key, default_var=None)}}

{{# or}}

{{val = Variable.setdefault(key, default="value")}}

```

On sqlite3 it's all fine, but not on postgres.

```

[SQL: SELECT variable.val AS variable_val, variable.id AS variable_id, variable.key AS variable_key,
variable.is_encrypted AS variable_is_encrypted 
 FROM variable 
 WHERE variable.key = %(key_1)s 
 LIMIT %(param_1)s]
 [parameters: 

{'key_1': 'dag_enabled', 'param_1': 1}

]
 (Background on this error at: [http://sqlalche.me/e/f405])
 ERROR [airflow.models.dagbag.DagBag] Failed to import: /home/joe/jupiter/cis/airflow/dags/cis/fsp/dags/dag_generator.py
 Traceback (most recent call last):
 File "/home/joe/.cache/pypoetry/virtualenvs/dags-py3.6/lib/python3.6/site-packages/sqlalchemy/engine/base.py",
line 1249, in _execute_context
 cursor, statement, parameters, context
 File "/home/joe/.cache/pypoetry/virtualenvs/dags-py3.6/lib/python3.6/site-packages/sqlalchemy/engine/default.py",
line 552, in do_execute
 cursor.execute(statement, parameters)
 psycopg2.ProgrammingError: relation "variable" does not exist
 LINE 2: FROM variable

```

  was:
While loading dags during a db-reset, before creating any DAG, some code attempts to get/set
a Variable, e.g.

```

val = Variable.get(key, default_var=None)
 # or

val = Variable.setdefault(key, default="value")

```

On sqlite3 it's all fine, but not on postgres.

```

[SQL: SELECT variable.val AS variable_val, variable.id AS variable_id, variable.key AS variable_key,
variable.is_encrypted AS variable_is_encrypted 
 FROM variable 
 WHERE variable.key = %(key_1)s 
 LIMIT %(param_1)s]
 [parameters: \\{'key_1': 'dag_enabled', 'param_1': 1}]
 (Background on this error at: [http://sqlalche.me/e/f405])
 ERROR [airflow.models.dagbag.DagBag] Failed to import: /home/joe/jupiter/cis/airflow/dags/cis/fsp/dags/dag_generator.py
 Traceback (most recent call last):
 File "/home/joe/.cache/pypoetry/virtualenvs/dags-py3.6/lib/python3.6/site-packages/sqlalchemy/engine/base.py",
line 1249, in _execute_context
 cursor, statement, parameters, context
 File "/home/joe/.cache/pypoetry/virtualenvs/dags-py3.6/lib/python3.6/site-packages/sqlalchemy/engine/default.py",
line 552, in do_execute
 cursor.execute(statement, parameters)
 psycopg2.ProgrammingError: relation "variable" does not exist
 LINE 2: FROM variable

```


> relation "variable" does not exist - psycopg2 - DagBag import
> -------------------------------------------------------------
>
>                 Key: AIRFLOW-5576
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-5576
>             Project: Apache Airflow
>          Issue Type: Bug
>          Components: DAG, database
>    Affects Versions: 1.10.5
>            Reporter: Darren Weber
>            Priority: Major
>
> While loading dags during a db-reset, before creating any DAG, some code attempts to
get/set a Variable, e.g.
> ```
> {{val = Variable.get(key, default_var=None)}}
> {{# or}}
> {{val = Variable.setdefault(key, default="value")}}
> ```
> On sqlite3 it's all fine, but not on postgres.
> ```
> [SQL: SELECT variable.val AS variable_val, variable.id AS variable_id, variable.key AS
variable_key, variable.is_encrypted AS variable_is_encrypted 
>  FROM variable 
>  WHERE variable.key = %(key_1)s 
>  LIMIT %(param_1)s]
>  [parameters: 
> {'key_1': 'dag_enabled', 'param_1': 1}
> ]
>  (Background on this error at: [http://sqlalche.me/e/f405])
>  ERROR [airflow.models.dagbag.DagBag] Failed to import: /home/joe/jupiter/cis/airflow/dags/cis/fsp/dags/dag_generator.py
>  Traceback (most recent call last):
>  File "/home/joe/.cache/pypoetry/virtualenvs/dags-py3.6/lib/python3.6/site-packages/sqlalchemy/engine/base.py",
line 1249, in _execute_context
>  cursor, statement, parameters, context
>  File "/home/joe/.cache/pypoetry/virtualenvs/dags-py3.6/lib/python3.6/site-packages/sqlalchemy/engine/default.py",
line 552, in do_execute
>  cursor.execute(statement, parameters)
>  psycopg2.ProgrammingError: relation "variable" does not exist
>  LINE 2: FROM variable
> ```



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message