airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Henning Redestig (Jira)" <j...@apache.org>
Subject [jira] [Updated] (AIRFLOW-5850) Make DockerSwarmOperator capture task logs
Date Fri, 08 Nov 2019 14:23:00 GMT

     [ https://issues.apache.org/jira/browse/AIRFLOW-5850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Henning Redestig updated AIRFLOW-5850:
--------------------------------------
    Description: 
contrib.operators.DockerSwarmOperator gives output on task starting and exiting but does not
capture the logs from the task.  E.g.


[2019-11-04 16:27:30,337] \{{docker_swarm_operator.py:125}} INFO - Service started: \{'ID':
'mxjn03sm32kfm8bcczs4qw6tu'}
\## the task outputs logs here but they do not show up in the webapp..
[2019-11-04 16:27:32,909] \{{docker_swarm_operator.py:136}} INFO - Service status before exiting:
complete
[2019-11-04 16:27:37,298] \{{logging_mixin.py:95}} INFO - [2019-11-04 16:27:37,298]

local_task_job.py:105}} INFO - Task exited with return code 0


 Also discussed in https://github.com/apache/airflow/pull/5489

  was:
contrib.operators.DockerSwarmOperator gives output on task starting and exiting but does not
capture the logs from the task.  E.g.

{{
[2019-11-04 16:27:30,337] \{{docker_swarm_operator.py:125}} INFO - Service started: \{'ID':
'mxjn03sm32kfm8bcczs4qw6tu'}
## the task outputs logs here but they do not show up in the webapp..
[2019-11-04 16:27:32,909] \{{docker_swarm_operator.py:136}} INFO - Service status before exiting:
complete
[2019-11-04 16:27:37,298] \{{logging_mixin.py:95}} INFO - [2019-11-04 16:27:37,298]
\{{local_task_job.py:105}} INFO - Task exited with return code 0
}}

 Also discussed in https://github.com/apache/airflow/pull/5489


> Make DockerSwarmOperator capture task logs
> ------------------------------------------
>
>                 Key: AIRFLOW-5850
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-5850
>             Project: Apache Airflow
>          Issue Type: Wish
>          Components: contrib, operators
>    Affects Versions: 1.10.6
>         Environment: Reproducible everywhere since missing feature - Tested via puckel/airflow:latest
>            Reporter: Henning Redestig
>            Priority: Major
>              Labels: docker, orchestration, swarm
>             Fix For: 1.10.7
>
>
> contrib.operators.DockerSwarmOperator gives output on task starting and exiting but does
not capture the logs from the task.  E.g.
> [2019-11-04 16:27:30,337] \{{docker_swarm_operator.py:125}} INFO - Service started: \{'ID':
'mxjn03sm32kfm8bcczs4qw6tu'}
> \## the task outputs logs here but they do not show up in the webapp..
> [2019-11-04 16:27:32,909] \{{docker_swarm_operator.py:136}} INFO - Service status before
exiting: complete
> [2019-11-04 16:27:37,298] \{{logging_mixin.py:95}} INFO - [2019-11-04 16:27:37,298]

> local_task_job.py:105}} INFO - Task exited with return code 0
>  Also discussed in https://github.com/apache/airflow/pull/5489



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message