airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF subversion and git services (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AIRFLOW-25) Configuration for Celery always required
Date Tue, 31 May 2016 07:04:13 GMT

    [ https://issues.apache.org/jira/browse/AIRFLOW-25?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15307318#comment-15307318
] 

ASF subversion and git services commented on AIRFLOW-25:
--------------------------------------------------------

Commit 03e8e5d49f2539057574daecd3f1711e666c29e9 in incubator-airflow's branch refs/heads/master
from [~sekikn]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-airflow.git;h=03e8e5d ]

[AIRFLOW-25] Configuration for Celery always required

Dear Airflow Maintainers,

Please accept this PR that addresses the following issues:
- AIRFLOW-25

For now, if airflow.cfg has no [celery] section, all subcommands fail.
This patch adds the default values for Celery-related properties
as well as existing 'default_queue' and 'flower_port',
so as to make all subcommands work and suppress "not found in config"
warnings even if [celery] section is omitted.

Author: Kengo Seki <sekikn@apache.org>

Closes #1558 from sekikn/AIRFLOW-25.


> Configuration for Celery always required
> ----------------------------------------
>
>                 Key: AIRFLOW-25
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-25
>             Project: Apache Airflow
>          Issue Type: Bug
>          Components: celery
>         Environment: Ubuntu 15.10, Airflow 1.7.0
>            Reporter: Ludovic Claude
>            Assignee: Kengo Seki
>            Priority: Trivial
>              Labels: newbie
>
> I have setup in airflow.cfg
>   airflow_executor = LocalExecutor
> and removed the [celery] section as I do not use it (I want to use MesosExecutor later
on)
> When I run
>   airflow initdb
> Airflow fails with this error:
> {code}
> [2016-04-30 23:53:38,430] {driver.py:120} INFO - Generating grammar tables from /usr/lib/python2.7/lib2to3/Grammar.txt
> [2016-04-30 23:53:38,455] {driver.py:120} INFO - Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt
> [2016-04-30 23:53:38,583] {configuration.py:424} WARNING - section/key [celery/broker_url]
not found in config
> [2016-04-30 23:53:38,583] {__init__.py:36} INFO - Using executor SequentialExecutor
> [2016-04-30 23:53:38,895] {configuration.py:424} WARNING - section/key [celery/celeryd_concurrency]
not found in config
> Traceback (most recent call last):
>   File "/usr/local/bin/airflow", line 13, in <module>
>     parser = get_parser()
>   File "/usr/local/lib/python2.7/dist-packages/airflow/bin/cli.py", line 751, in get_parser
>     default=configuration.get('celery', 'celeryd_concurrency'))
>   File "/usr/local/lib/python2.7/dist-packages/airflow/configuration.py", line 520, in
get
>     return conf.get(section, key, **kwargs)
>   File "/usr/local/lib/python2.7/dist-packages/airflow/configuration.py", line 428, in
get
>     "in config".format(**locals()))
> airflow.configuration.AirflowConfigException: section/key [celery/celeryd_concurrency]
not found in config
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message