airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From fo...@apache.org
Subject incubator-airflow git commit: [AIRFLOW-2348] Strip path prefix from the destination_object when source_object contains a wildcard[]
Date Sat, 28 Apr 2018 18:45:22 GMT
Repository: incubator-airflow
Updated Branches:
  refs/heads/v1-10-test 9215cdd4c -> 143886209


[AIRFLOW-2348] Strip path prefix from the destination_object when source_object contains a
wildcard[]

Closes #3247 from csoulios/master

(cherry picked from commit 840930b4d0c545adc24d8eb040974f88370e081b)
Signed-off-by: Fokko Driesprong <fokkodriesprong@godatadriven.com>


Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-airflow/commit/14388620
Tree: http://git-wip-us.apache.org/repos/asf/incubator-airflow/tree/14388620
Diff: http://git-wip-us.apache.org/repos/asf/incubator-airflow/diff/14388620

Branch: refs/heads/v1-10-test
Commit: 143886209716b041402e78a1313c54336edb840a
Parents: 9215cdd
Author: Christos Soulios <csoulios@gmail.com>
Authored: Sat Apr 28 20:44:53 2018 +0200
Committer: Fokko Driesprong <fokkodriesprong@godatadriven.com>
Committed: Sat Apr 28 20:45:15 2018 +0200

----------------------------------------------------------------------
 airflow/contrib/operators/gcs_to_gcs.py | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/incubator-airflow/blob/14388620/airflow/contrib/operators/gcs_to_gcs.py
----------------------------------------------------------------------
diff --git a/airflow/contrib/operators/gcs_to_gcs.py b/airflow/contrib/operators/gcs_to_gcs.py
index 6acc517..9bcf9d4 100644
--- a/airflow/contrib/operators/gcs_to_gcs.py
+++ b/airflow/contrib/operators/gcs_to_gcs.py
@@ -99,7 +99,7 @@ class GoogleCloudStorageToGoogleCloudStorageOperator(BaseOperator):
             for source_object in objects:
                 if self.destination_object:
                     destination_object = "{}/{}".format(self.destination_object,
-                                                        source_object)
+                                                        source_object[wildcard_position:])
                 else:
                     destination_object = source_object
                 self.log.info('Executing copy of gs://{0}/{1} to '


Mime
View raw message