airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF subversion and git services (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AIRFLOW-2330) GoogleCloudStorageToGoogleCloudStorageOperator on wildcard appends destination_object even when not given
Date Thu, 19 Apr 2018 08:27:00 GMT

    [ https://issues.apache.org/jira/browse/AIRFLOW-2330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16443725#comment-16443725
] 

ASF subversion and git services commented on AIRFLOW-2330:
----------------------------------------------------------

Commit 17d3d1d9dc87c0bbb03de049607c2ad76a4fd747 in incubator-airflow's branch refs/heads/master
from [~b11c]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-airflow.git;h=17d3d1d ]

[AIRFLOW-2330] Do not append destination prefix if not given

Closes #3233 from berislavlopac/AIRFLOW-2330


> GoogleCloudStorageToGoogleCloudStorageOperator on wildcard appends destination_object
even when not given
> ---------------------------------------------------------------------------------------------------------
>
>                 Key: AIRFLOW-2330
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-2330
>             Project: Apache Airflow
>          Issue Type: Bug
>            Reporter: Berislav Lopac
>            Assignee: Berislav Lopac
>            Priority: Major
>             Fix For: 2.0.0
>
>
> Currently, the operator builds the destination like this:
> {code}
>     hook.copy(self.source_bucket, source_object,
>               self.destination_bucket, "{}/{}".format(self.destination_object,
>                                                       source_object))
> {code}
> If destination is {{None}} (the default) the file will land in {{None/\{source_object\}}},
and if it's an empty string it goes to {{/\{source_object\}}}. Basically, it should not prepend
{{destination_object}} if it's empty.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message