airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Victor Duarte Diniz Monteiro (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AIRFLOW-1436) EmrJobFlowSensor consideres Cancelled step as Successful
Date Mon, 31 Jul 2017 02:04:01 GMT

    [ https://issues.apache.org/jira/browse/AIRFLOW-1436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16106731#comment-16106731
] 

Victor Duarte Diniz Monteiro commented on AIRFLOW-1436:
-------------------------------------------------------

Well, I think it should allow `NON_TERMINAL_STATES` and `FAILED_STATES` to be both a list
and be set through `EMRStepSensor` constructor. I will raise a issue about changing `EMRBaseSensor`
to allow this.

> EmrJobFlowSensor consideres Cancelled step as Successful
> --------------------------------------------------------
>
>                 Key: AIRFLOW-1436
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-1436
>             Project: Apache Airflow
>          Issue Type: Bug
>          Components: aws
>            Reporter: Martin Zlocha
>            Priority: Trivial
>
> When steps are added to an EMR cluster and then cancelled, the EmrJobFlowSensor considers
them as successful but they should be failed because they didn't complete.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message