From dev-return-8433-archive-asf-public=cust-asf.ponee.io@airflow.apache.org Wed May 8 15:04:33 2019 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [207.244.88.153]) by mx-eu-01.ponee.io (Postfix) with SMTP id 89C62180630 for ; Wed, 8 May 2019 17:04:33 +0200 (CEST) Received: (qmail 14366 invoked by uid 500); 8 May 2019 15:04:32 -0000 Mailing-List: contact dev-help@airflow.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@airflow.apache.org Delivered-To: mailing list dev@airflow.apache.org Received: (qmail 14355 invoked by uid 99); 8 May 2019 15:04:32 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 08 May 2019 15:04:32 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 9CA57C9569 for ; Wed, 8 May 2019 15:04:31 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -0.301 X-Spam-Level: X-Spam-Status: No, score=-0.301 tagged_above=-999 required=6.31 tests=[HTML_MESSAGE=2, RCVD_IN_DNSWL_MED=-2.3, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id adqZjHAp70g1 for ; Wed, 8 May 2019 15:04:27 +0000 (UTC) Received: from mail-gw30.credit-suisse.com (mail-gw30.credit-suisse.com [198.240.130.136]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id 7829A5F324 for ; Wed, 8 May 2019 15:04:27 +0000 (UTC) Received: by mail-gw30.credit-suisse.com; Wed, 8 May 2019 15:04:14 GMT From: "Shaw, Damian P. " To: "dev@airflow.apache.org" Subject: Manual raising of AirflowRescheduleException supported? Thread-Topic: Manual raising of AirflowRescheduleException supported? Thread-Index: AdUFr0m9/24nBqYPQUeMXOZjh8L8kw== Date: Wed, 8 May 2019 15:04:10 +0000 Message-ID: Accept-Language: en-GB, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-sentfromoutlook: SentFromOutlook Content-Type: multipart/alternative; boundary="_000_B5AEA663E679704088A206F221FBE30720FBF554USW20015557gbla_" MIME-Version: 1.0 --_000_B5AEA663E679704088A206F221FBE30720FBF554USW20015557gbla_ Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Hi all, Reading the reschedule code I notice that the execute method of the BaseSensorOperator raises "AirflowRescheduleException(reschedule_date)" I have a scenario where I would like to reschedule to a custom datetime, is it supported to manually raise this from my own custom Sensor? This is the scenario I have: some tasks initially need to wait anywhere from 30 minutes to 12 hours. Currently I have my own version of the TimeSensor set-up to reschedule itself every 15 minutes by default and check if the task is ready to run. However this leads to a few problems: 1. The reschedule drifts away from the 15 minute mark 2. 15 minutes is already a lot more course than I would like 3. It's still running a process and checking every 15 minutes for up to 12 hours Thanks for any info, Damian Shaw =============================================================================== Please access the attached hyperlink for an important electronic communications disclaimer: http://www.credit-suisse.com/legal/en/disclaimer_email_ib.html =============================================================================== --_000_B5AEA663E679704088A206F221FBE30720FBF554USW20015557gbla_--