airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From GitBox <...@apache.org>
Subject [GitHub] [airflow] potiuk edited a comment on issue #6445: [AIRFLOW-5735][AIP-21] Move airflow.contrib.operators.s3_to_gcs_operator to core
Date Sun, 27 Oct 2019 17:46:36 GMT
potiuk edited a comment on issue #6445: [AIRFLOW-5735][AIP-21] Move airflow.contrib.operators.s3_to_gcs_operator
to core
URL: https://github.com/apache/airflow/pull/6445#issuecomment-546717447
 
 
   Actually I started to think that transfer operators should be placed in  "destination"
rather than "source".
   
   What do you think @louisguitton @BasPH @mik-laj ? 
   
   Some background: Initially I thought it does not matter whether we choose source or target.
But now I think differently - if we think in the future about splitting different providers
to separate packages, and getting some kind of "stewardship" over the operator groups, it
makes much more sense that the s3_to_gcs is under the "stewardship" of people who take care
about the "providers/google" package rather than those of "providers/amazon". 
   
   Knowing how it works, I guess people who take care about Google will be much more interested
to transfer data from S3 to GCP rather than other way round. 
   
   I will ask at the devlist if you share my feelings.
   
   FYI @louisguitton FYI -> we are in the process of moving "providers/gcp" to "providers/google/[gcp,
gsuite]" - this is the latest agreed proposal 
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

Mime
View raw message