airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Anil Kumar (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (AIRFLOW-2104) Recommendation for Airflow design/architecture
Date Tue, 13 Feb 2018 09:00:05 GMT

     [ https://issues.apache.org/jira/browse/AIRFLOW-2104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Anil Kumar updated AIRFLOW-2104:
--------------------------------
    Description: 
Hello,

We are in the implementation phase for Apache Airflow and looking for Recommendation on
Airflow configuration/structure.

Which one will be best option
 # Airflow standalone installation with multi worker nodes or
 # Airflow running as docker image on Kubernetes

Requirement :-

We are suppose to schedule a long running ETL process that includes complex unzip/decrypt
task, execution of data wrangling UDF's.

  was:
Hello,

We are implementation phase for Apache Airflow and looking for Recommendation on Airflow
configuration/structure.

Which one will be best
 # Airflow standalone installation with multi worker nodes or
 # Airflow running as docker image on Kubernetes

Requirement :-

We are suppose to schedule a long running ETL process that includes complex unzip/decrypt
task, execution of data wrangling UDF's.


> Recommendation for Airflow design/architecture
> ----------------------------------------------
>
>                 Key: AIRFLOW-2104
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-2104
>             Project: Apache Airflow
>          Issue Type: Improvement
>          Components: celery, configuration, DagRun
>    Affects Versions: 1.9.0
>            Reporter: Anil Kumar
>            Priority: Major
>             Fix For: 1.9.0
>
>
> Hello,
> We are in the implementation phase for Apache Airflow and looking for Recommendation on
Airflow configuration/structure.
> Which one will be best option
>  # Airflow standalone installation with multi worker nodes or
>  # Airflow running as docker image on Kubernetes
> Requirement :-
> We are suppose to schedule a long running ETL process that includes complex unzip/decrypt
task, execution of data wrangling UDF's.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message