airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Joseph Yen (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (AIRFLOW-1356) add `--celery_hostname` to `airflow worker`
Date Thu, 29 Jun 2017 04:52:00 GMT

     [ https://issues.apache.org/jira/browse/AIRFLOW-1356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Joseph Yen updated AIRFLOW-1356:
--------------------------------
    Description: 
If we start multiple `celery worker` on the same machine, each worker should have individual
hostname to distinguish each other. Otherwise, some tools might not work correctly. E.g. celery
flower would show only one worker if all workers are of the same hostname.

It's necessary to have `--celery_hostname` option on `airflow worker` subcommand, and the
option should accept an argument with the syntax as same as the option `-n` of `celery worker`
command.

celery worker doc: http://docs.celeryproject.org/en/latest/userguide/workers.html

bq. {{airflow worker -c 1 -q highmem -cn highmem@%h}}

  was:
If we start multiple `celery worker` on the same machine, each worker should have individual
hostname to distinguish each other. Otherwise, some tools might not work correctly. E.g. celery
flower would show only one worker if all workers are of the same hostname.

It's necessary to have `--celery_hostname` option on `airflow worker` subcommand, and the
option should accept an argument with the syntax as same as the option `-n` of `celery worker`
command.

celery worker doc: http://docs.celeryproject.org/en/latest/userguide/workers.html



> add `--celery_hostname` to `airflow worker`
> -------------------------------------------
>
>                 Key: AIRFLOW-1356
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-1356
>             Project: Apache Airflow
>          Issue Type: Improvement
>          Components: celery, cli
>    Affects Versions: 1.8.1
>            Reporter: Joseph Yen
>            Priority: Minor
>              Labels: easyfix, newbie
>
> If we start multiple `celery worker` on the same machine, each worker should have individual
hostname to distinguish each other. Otherwise, some tools might not work correctly. E.g. celery
flower would show only one worker if all workers are of the same hostname.
> It's necessary to have `--celery_hostname` option on `airflow worker` subcommand, and
the option should accept an argument with the syntax as same as the option `-n` of `celery
worker` command.
> celery worker doc: http://docs.celeryproject.org/en/latest/userguide/workers.html
> bq. {{airflow worker -c 1 -q highmem -cn highmem@%h}}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message