From dev-return-6114-archive-asf-public=cust-asf.ponee.io@airflow.incubator.apache.org Thu Aug 9 23:13:21 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id 79A1A18065B for ; Thu, 9 Aug 2018 23:13:20 +0200 (CEST) Received: (qmail 8765 invoked by uid 500); 9 Aug 2018 21:13:19 -0000 Mailing-List: contact dev-help@airflow.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@airflow.incubator.apache.org Delivered-To: mailing list dev@airflow.incubator.apache.org Received: (qmail 8749 invoked by uid 99); 9 Aug 2018 21:13:18 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 09 Aug 2018 21:13:18 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 4C8C31A2367 for ; Thu, 9 Aug 2018 21:13:18 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.889 X-Spam-Level: * X-Spam-Status: No, score=1.889 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, SPF_PASS=-0.001, T_DKIMWL_WL_MED=-0.01] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id NbKMsR1mGn_Z for ; Thu, 9 Aug 2018 21:13:16 +0000 (UTC) Received: from mail-lj1-f173.google.com (mail-lj1-f173.google.com [209.85.208.173]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id E0E685F30E for ; Thu, 9 Aug 2018 21:13:15 +0000 (UTC) Received: by mail-lj1-f173.google.com with SMTP id 203-v6so5548453ljj.13 for ; Thu, 09 Aug 2018 14:13:15 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=5M7su/fZm4N2SAxHWou12wF8sjXExtg2yzHe/VRP/Vo=; b=cN+TBnAtNF0z49IH0ClfUBPmhbdlWGtvQ6r/EKVOouptm/fiGPALesi2g7XYcPPeYq cAw5UcUsN2PNQao3QuIlkoBWJhcarWrlvAuAiFHv1PZ+D2sEvETcy65IxFuULNG/JqSL AaFda6FlMD9EPUriGX+NAImCaM/rF9UZ5E41yYMEbLPBGRwZIrvy9XAz+uOQYTpgXeKa rxt1/GATcHYoIpuH6ef8NPGJcpCBJmCPkIeuSVqEDS2EcMhBpwZuXJe296CsoNsSwtNi 0xv4RY2AVQlQGYKUgS4mq+GWZElgtsr4aLXL3xYap1xg4YgrblY9yrK1DhMoUhZtl14F 0aww== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=5M7su/fZm4N2SAxHWou12wF8sjXExtg2yzHe/VRP/Vo=; b=Y8PJzSFgZLyvQLLIafZ3LU+ynfmTv+Fnf5XSvzGmFcELYjQ8QYkFkNQ3qkWrLq6gnh CextPbY7rCQXToZYdCa+jdK0T3j+oQzs/etmLxjoodo1M/2sD3fckQ0XSFb+NHomcZLj ZuwjkDxQvxfX+TaCnU80HHrSxx3VrBCxTsjPJzUmOuo74bSWUjjntIK6JvMsIFITjqss cIgVgxt4+uLEoR9L20tQ1UscKaLMtdy4BMl8Qxn2sz1WV1KAYhL05GGT6f5hebp2GTSa sQmWEDJfBdKXNqNY42CPU/O7RCB8bjBoiRFYb3B7fG/r3eExCa8Ox5IXmC/hWkkYQg4u Q7Og== X-Gm-Message-State: AOUpUlGQzgK4s7Vg76mmhAC76dBbQQYdQlmwo5GWJdfM4KbFh0SZGBHs 7L+4TK5kfY3WOtoBKieXH69it9c2S1BwuPYuH2Xg1lK3 X-Google-Smtp-Source: AA+uWPw1gPmSu1YQWtSYhbo5cEeOhg2Hrp3CuSGf47wGNyltASShR2Qlwz1n5BHk47Zfeg/Wp8kU7+CLNESOz69MTjY= X-Received: by 2002:a2e:534e:: with SMTP id t14-v6mr2867710ljd.26.1533849194214; Thu, 09 Aug 2018 14:13:14 -0700 (PDT) MIME-Version: 1.0 Received: by 2002:a2e:5656:0:0:0:0:0 with HTTP; Thu, 9 Aug 2018 14:13:13 -0700 (PDT) In-Reply-To: References: From: Ben Laird Date: Thu, 9 Aug 2018 17:13:13 -0400 Message-ID: Subject: Re: Broken DAG message won't go away in webserver To: dev@airflow.incubator.apache.org Content-Type: multipart/alternative; boundary="0000000000005c393c057307186f" --0000000000005c393c057307186f Content-Type: text/plain; charset="UTF-8" The messages persist even after restarting the webserver. I've verified with other airflow users in the office that they'd have to manually delete records from the 'import_error' table. When you say 'sync your DAGs', what do you mean exactly? When we fix a DAG, we'd normally kill the webserver process, push a zip containing our dag directory (with the fixed code), unzip and restart the webserver. Thanks On Thu, Aug 9, 2018 at 4:43 PM, Taylor Edmiston wrote: > Yeah, you definitely shouldn't need to do a resetdb for that. > > Did you try restarting the webserver? > > How do you sync your DAGs to the webserver? Is it possible the fixed DAG > didn't get synced there? > > For me, IIRC, the error stops persisting once the DAG is fixed and synced. > > *Taylor Edmiston* > Blog | CV > | LinkedIn > | AngelList > | Stack Overflow > > > > On Thu, Aug 9, 2018 at 3:35 PM, Ben Laird wrote: > > > Hello - > > > > I've noticed this several times and not sure what the solution is. If I > > have a DAG error at some point, I'll see message in the webserver that > says > > "Broken DAG: [Error]". However, after fixing the code, restarting the > > webserver, etc, the error persists. After closing it out, it will just > pop > > up again after reloading. > > > > The only way I was able to delete was by doing a `airflow resetdb`. I'd > > like to avoid manually deleting records from the DB, as now in prod we > > cannot just kill the DB state. > > > > Any suggestions? > > > > Thanks, > > Ben Laird > > > --0000000000005c393c057307186f--