airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ruslan Dautkhanov (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (AIRFLOW-1176) Gantt graph is broken for @once DAG
Date Sun, 07 May 2017 05:07:04 GMT

     [ https://issues.apache.org/jira/browse/AIRFLOW-1176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Ruslan Dautkhanov updated AIRFLOW-1176:
---------------------------------------
    Description: 
Gantt visualization is brojen. 
It used to work on a ~month older Airflow snapshot. 

See attached screenshot.

!Gantt.png!

- It just doesn't show anything (it used to show all >40 operators correctly)
- time scale is shifted so almost no visible

It is a `@once` DAG.. I noticed Airflow has a number of issues around `@once` DAG, so decided
to mention.

{noformat}
main_dag = DAG(
    dag_id                         = 'DISCOVER-Oracle-Load-Mar2017-v1',
    default_args                   = default_args,                  # dafeult operators' arguments
- see above
    user_defined_macros            = dag_macros,       # I do not get different between
    ## params                         = dag_macros,       # user_defined_macros and params
    #
    start_date                     = datetime.now(),                # or e.g. datetime(2015,
6, 1)
    # 'end_date'                   = datetime(2016, 1, 1),
    catchup                        = False,                         # Perform scheduler catchup
(or only run latest)?
                                                                        # - defaults to True
    schedule_interval              = '@once',                       # '@once'=None?
                                                                     # doesn't create multiple
dag runs automatically
    concurrency                    = 3,                             # task instances allowed
to run concurrently
    max_active_runs                = 1,                             # only one DAG run at
a time
    dagrun_timeout                 = timedelta(days=4),             # no way this dag should
ran for 4 days
    orientation                    = 'TB',                          # default graph view
)
{noformat}

  was:
Gantt visualization is brojen. 
It used to work on a ~month older Airflow snapshot. 

See attached screenshot.

- It just doesn't show anything (it used to show all >40 operators correctly)
- time scale is shifted so almost no visible

It is a `@once` DAG.. I noticed Airflow has a number of issues around `@once` DAG, so decided
to mention.

{noformat}
main_dag = DAG(
    dag_id                         = 'DISCOVER-Oracle-Load-Mar2017-v1',
    default_args                   = default_args,                  # dafeult operators' arguments
- see above
    user_defined_macros            = dag_macros,       # I do not get different between
    ## params                         = dag_macros,       # user_defined_macros and params
    #
    start_date                     = datetime.now(),                # or e.g. datetime(2015,
6, 1)
    # 'end_date'                   = datetime(2016, 1, 1),
    catchup                        = False,                         # Perform scheduler catchup
(or only run latest)?
                                                                        # - defaults to True
    schedule_interval              = '@once',                       # '@once'=None?
                                                                     # doesn't create multiple
dag runs automatically
    concurrency                    = 3,                             # task instances allowed
to run concurrently
    max_active_runs                = 1,                             # only one DAG run at
a time
    dagrun_timeout                 = timedelta(days=4),             # no way this dag should
ran for 4 days
    orientation                    = 'TB',                          # default graph view
)
{noformat}


> Gantt graph is broken for @once DAG
> -----------------------------------
>
>                 Key: AIRFLOW-1176
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-1176
>             Project: Apache Airflow
>          Issue Type: Bug
>    Affects Versions: Airflow 1.8, 1.8.1, 1.8.0
>         Environment: May-05-2017 Airflow master snapshot
>            Reporter: Ruslan Dautkhanov
>         Attachments: Gantt.png
>
>
> Gantt visualization is brojen. 
> It used to work on a ~month older Airflow snapshot. 
> See attached screenshot.
> !Gantt.png!
> - It just doesn't show anything (it used to show all >40 operators correctly)
> - time scale is shifted so almost no visible
> It is a `@once` DAG.. I noticed Airflow has a number of issues around `@once` DAG, so
decided to mention.
> {noformat}
> main_dag = DAG(
>     dag_id                         = 'DISCOVER-Oracle-Load-Mar2017-v1',
>     default_args                   = default_args,                  # dafeult operators'
arguments - see above
>     user_defined_macros            = dag_macros,       # I do not get different between
>     ## params                         = dag_macros,       # user_defined_macros and params
>     #
>     start_date                     = datetime.now(),                # or e.g. datetime(2015,
6, 1)
>     # 'end_date'                   = datetime(2016, 1, 1),
>     catchup                        = False,                         # Perform scheduler
catchup (or only run latest)?
>                                                                         # - defaults
to True
>     schedule_interval              = '@once',                       # '@once'=None?
>                                                                      # doesn't create
multiple dag runs automatically
>     concurrency                    = 3,                             # task instances
allowed to run concurrently
>     max_active_runs                = 1,                             # only one DAG run
at a time
>     dagrun_timeout                 = timedelta(days=4),             # no way this dag
should ran for 4 days
>     orientation                    = 'TB',                          # default graph view
> )
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message