airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF subversion and git services (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AIRFLOW-1676) GCS task handler never writes to GCS
Date Fri, 06 Oct 2017 17:43:01 GMT

    [ https://issues.apache.org/jira/browse/AIRFLOW-1676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16194930#comment-16194930
] 

ASF subversion and git services commented on AIRFLOW-1676:
----------------------------------------------------------

Commit 0080f0fcc86200a4369a79ababc318a72d8bc8c6 in incubator-airflow's branch refs/heads/v1-9-test
from [~ahvigil]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-airflow.git;h=0080f0f ]

[AIRFLOW-1682] Make S3TaskHandler write to S3 on close

Applies fix for GCSTaskHandler made as part of AIRFLOW-1676 to fix
the same bug in S3TaskHandler. Also rename s3_log_read function to
s3_read for consistency with other functions in airflow.utils.log

Closes #2664 from ahvigil/AIRFLOW-1682


> GCS task handler never writes to GCS
> ------------------------------------
>
>                 Key: AIRFLOW-1676
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-1676
>             Project: Apache Airflow
>          Issue Type: Bug
>            Reporter: Chris Riccomini
>            Assignee: Chris Riccomini
>             Fix For: 1.9.0
>
>
> I discovered a bug in 1.9.0alpha0 with GCSTaskHandler. It seems to be that it's impossible
for this task handler to write to GCS. When close() is called, it always returns immediately
because _hook is never set.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message