airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kevin (JIRA)" <j...@apache.org>
Subject [jira] [Created] (AIRFLOW-2392) bashoperator bug with python script inside a docker inside airflow
Date Sun, 29 Apr 2018 13:30:00 GMT
Kevin created AIRFLOW-2392:
------------------------------

             Summary: bashoperator bug with python script inside a docker inside airflow
                 Key: AIRFLOW-2392
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-2392
             Project: Apache Airflow
          Issue Type: Bug
          Components: DAG
    Affects Versions: Airflow 1.8
         Environment: linux centOS
            Reporter: Kevin


when executing a python script with parameters, inside a docker inside airflow bashoperator,

it does take into account the python arguments.

Process is :

  SSH --> server --> Dockerimage --> python script with args.

 

{{a02_retrieve_2 = SSHExecuteOperator( task_id='a02_retrieve_2', ssh_hook=sshHook, dag=dag,
bash_command= 'docker exec myDocker -i bash -c " /opt/conda/bin/python aretrieve_2.py --myarg1
45 --myarg2 35 " ' )}}

 

 

{{Python script starts to run BUT}}

{{It failed to capture values for myarg1 and myarg2.}}

 

{{This is a serious bug since python script with arguments cannot be run inside airflow.}}

 

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message